annotate bitten/web_ui.py @ 437:6d5ac24061dc

Fix build queue population compatiblity with Trac 0.11, where revision timestamps are `datetime` objects.
author cmlenz
date Fri, 17 Aug 2007 11:15:43 +0000
parents cfbc9ee622d5
children 99d516f75169
rev   line source
379
0df178e07fdb Use UTF-8 as encoding of source files.
cmlenz
parents: 376
diff changeset
1 # -*- coding: utf-8 -*-
35
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
2 #
408
933105ab516b Update file headers and other stuff pointing to the old home.
cmlenz
parents: 391
diff changeset
3 # Copyright (C) 2005-2007 Christopher Lenz <cmlenz@gmx.de>
933105ab516b Update file headers and other stuff pointing to the old home.
cmlenz
parents: 391
diff changeset
4 # Copyright (C) 2007 Edgewall Software
163
634be6cbb808 Flip the switch: Bitten is now BSD-licensed.
cmlenz
parents: 161
diff changeset
5 # All rights reserved.
35
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
6 #
163
634be6cbb808 Flip the switch: Bitten is now BSD-licensed.
cmlenz
parents: 161
diff changeset
7 # This software is licensed as described in the file COPYING, which
634be6cbb808 Flip the switch: Bitten is now BSD-licensed.
cmlenz
parents: 161
diff changeset
8 # you should have received as part of this distribution. The terms
408
933105ab516b Update file headers and other stuff pointing to the old home.
cmlenz
parents: 391
diff changeset
9 # are also available at http://bitten.edgewall.org/wiki/License.
35
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
10
316
87c9b1e8f086 More docstring improvements.
cmlenz
parents: 311
diff changeset
11 """Implementation of the Bitten web interface."""
87c9b1e8f086 More docstring improvements.
cmlenz
parents: 311
diff changeset
12
295
5f84af72d17f * Store executable bit in ZIP archives (from `svn:executable`).
cmlenz
parents: 263
diff changeset
13 from datetime import datetime
258
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
14 import posixpath
35
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
15 import re
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
16 from StringIO import StringIO
35
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
17
99
efc1eed69ba8 Make Bitten deployable in Trac as a [http://peak.telecommunity.com/DevCenter/PythonEggs Python egg].
cmlenz
parents: 98
diff changeset
18 import pkg_resources
35
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
19 from trac.core import *
362
4645863d7966 Fix for a compatibility problem with Trac 0.11dev.
cmlenz
parents: 361
diff changeset
20 try:
4645863d7966 Fix for a compatibility problem with Trac 0.11dev.
cmlenz
parents: 361
diff changeset
21 from trac.timeline import ITimelineEventProvider
4645863d7966 Fix for a compatibility problem with Trac 0.11dev.
cmlenz
parents: 361
diff changeset
22 except ImportError:
4645863d7966 Fix for a compatibility problem with Trac 0.11dev.
cmlenz
parents: 361
diff changeset
23 from trac.Timeline import ITimelineEventProvider
321
8e8d40d50001 Removed too much of the escaping in [333].
cmlenz
parents: 320
diff changeset
24 from trac.util import escape, pretty_timedelta, format_datetime, shorten_line, \
8e8d40d50001 Removed too much of the escaping in [333].
cmlenz
parents: 320
diff changeset
25 Markup
174
79c61c26a4e1 * Changed the `IReportStore` interface to allow querying with [http://www.w3.org/XML/Query/ XQuery]. This should make it possible to efficiently query the report store for any existing metrics.
cmlenz
parents: 168
diff changeset
26 from trac.web import IRequestHandler
74
1d4fa4c32afa Add template and static resources, hooked up using the new {{{ITemplateProvider}}} extension point in Trac.
cmlenz
parents: 73
diff changeset
27 from trac.web.chrome import INavigationContributor, ITemplateProvider, \
1d4fa4c32afa Add template and static resources, hooked up using the new {{{ITemplateProvider}}} extension point in Trac.
cmlenz
parents: 73
diff changeset
28 add_link, add_stylesheet
255
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
29 from trac.wiki import wiki_to_html, wiki_to_oneliner
410
7930cdd83d13 More restructuring: got rid of the `trac_ext` subpackage, which makes no sense now that the master is also coupled to Trac.
cmlenz
parents: 409
diff changeset
30 from bitten.api import ILogFormatter, IReportChartGenerator, IReportSummarizer
203
e6ddca1e5712 Huge refactoring to remove dependency on BDB XML. Report data is now stored in the Trac database (SQLite/PostgreSQL).
cmlenz
parents: 200
diff changeset
31 from bitten.model import BuildConfig, TargetPlatform, Build, BuildStep, \
e6ddca1e5712 Huge refactoring to remove dependency on BDB XML. Report data is now stored in the Trac database (SQLite/PostgreSQL).
cmlenz
parents: 200
diff changeset
32 BuildLog, Report
228
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
33 from bitten.queue import collect_changes
114
ecc062d4fd55 Paths to files and directories in the build log output are rendered as links to the repository browser.
cmlenz
parents: 112
diff changeset
34
255
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
35 _status_label = {Build.PENDING: 'pending',
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
36 Build.IN_PROGRESS: 'in progress',
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
37 Build.SUCCESS: 'completed',
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
38 Build.FAILURE: 'failed'}
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
39
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
40 def _build_to_hdf(env, req, build):
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
41 hdf = {'id': build.id, 'name': build.slave, 'rev': build.rev,
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
42 'status': _status_label[build.status],
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
43 'cls': _status_label[build.status].replace(' ', '-'),
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
44 'href': req.href.build(build.config, build.id),
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
45 'chgset_href': req.href.changeset(build.rev)}
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
46 if build.started:
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
47 hdf['started'] = format_datetime(build.started)
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
48 hdf['started_delta'] = pretty_timedelta(build.started)
381
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
49 hdf['duration'] = pretty_timedelta(build.started)
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
50 if build.stopped:
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
51 hdf['stopped'] = format_datetime(build.stopped)
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
52 hdf['stopped_delta'] = pretty_timedelta(build.stopped)
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
53 hdf['duration'] = pretty_timedelta(build.stopped, build.started)
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
54 hdf['slave'] = {
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
55 'name': build.slave,
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
56 'ipnr': build.slave_info.get(Build.IP_ADDRESS),
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
57 'os.name': build.slave_info.get(Build.OS_NAME),
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
58 'os.family': build.slave_info.get(Build.OS_FAMILY),
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
59 'os.version': build.slave_info.get(Build.OS_VERSION),
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
60 'machine': build.slave_info.get(Build.MACHINE),
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
61 'processor': build.slave_info.get(Build.PROCESSOR)
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
62 }
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
63 return hdf
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
64
318
c042e2c7048c Minor cleanup.
cmlenz
parents: 316
diff changeset
65
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
66 class BittenChrome(Component):
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
67 """Provides the Bitten templates and static resources."""
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
68
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
69 implements(INavigationContributor, ITemplateProvider)
64
de1a7499f4d6 Basic timeline provider for builds.
cmlenz
parents: 60
diff changeset
70
35
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
71 # INavigationContributor methods
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
72
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
73 def get_active_navigation_item(self, req):
316
87c9b1e8f086 More docstring improvements.
cmlenz
parents: 311
diff changeset
74 """Called by Trac to determine which navigation item should be marked
87c9b1e8f086 More docstring improvements.
cmlenz
parents: 311
diff changeset
75 as active.
87c9b1e8f086 More docstring improvements.
cmlenz
parents: 311
diff changeset
76
411
a169d2e96463 Use reStructuredText as the API documentation syntax.
cmlenz
parents: 410
diff changeset
77 :param req: the request object
316
87c9b1e8f086 More docstring improvements.
cmlenz
parents: 311
diff changeset
78 """
35
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
79 return 'build'
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
80
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
81 def get_navigation_items(self, req):
316
87c9b1e8f086 More docstring improvements.
cmlenz
parents: 311
diff changeset
82 """Return the navigation item for access the build status overview from
87c9b1e8f086 More docstring improvements.
cmlenz
parents: 311
diff changeset
83 the Trac navigation bar."""
50
0d5ad32948b7 Restrict access to web interface with custom permission actions.
cmlenz
parents: 47
diff changeset
84 if not req.perm.has_permission('BUILD_VIEW'):
0d5ad32948b7 Restrict access to web interface with custom permission actions.
cmlenz
parents: 47
diff changeset
85 return
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
86 yield ('mainnav', 'build', \
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
87 Markup('<a href="%s" accesskey="5">Build Status</a>',
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
88 req.href.build()))
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
89
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
90 # ITemplatesProvider methods
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
91
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
92 def get_htdocs_dirs(self):
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
93 """Return the directories containing static resources."""
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
94 return [('bitten', pkg_resources.resource_filename(__name__, 'htdocs'))]
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
95
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
96 def get_templates_dirs(self):
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
97 """Return the directories containing templates."""
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
98 return [pkg_resources.resource_filename(__name__, 'templates')]
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
99
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
100
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
101 class BuildConfigController(Component):
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
102 """Implements the web interface for build configurations."""
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
103
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
104 implements(IRequestHandler)
35
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
105
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
106 # IRequestHandler methods
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
107
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
108 def match_request(self, req):
184
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
109 match = re.match(r'/build(?:/([\w.-]+))?/?$', req.path_info)
35
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
110 if match:
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
111 if match.group(1):
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
112 req.args['config'] = match.group(1)
35
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
113 return True
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
114
67631e1d4d45 Some stubbed out code for the Bitten/Trac-integration. This creates a {{{bitten_build}}} table on database upgrade after the plugin is enabled.
cmlenz
parents:
diff changeset
115 def process_request(self, req):
50
0d5ad32948b7 Restrict access to web interface with custom permission actions.
cmlenz
parents: 47
diff changeset
116 req.perm.assert_permission('BUILD_VIEW')
0d5ad32948b7 Restrict access to web interface with custom permission actions.
cmlenz
parents: 47
diff changeset
117
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
118 action = req.args.get('action')
381
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
119 view = req.args.get('view')
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
120 config = req.args.get('config')
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
121
436
cfbc9ee622d5 Finish the move of build configuration management into the admin interface.
cmlenz
parents: 423
diff changeset
122 if config:
cfbc9ee622d5 Finish the move of build configuration management into the admin interface.
cmlenz
parents: 423
diff changeset
123 self._render_config(req, config)
cfbc9ee622d5 Finish the move of build configuration management into the admin interface.
cmlenz
parents: 423
diff changeset
124 elif view == 'inprogress':
cfbc9ee622d5 Finish the move of build configuration management into the admin interface.
cmlenz
parents: 423
diff changeset
125 self._render_inprogress(req)
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
126 else:
436
cfbc9ee622d5 Finish the move of build configuration management into the admin interface.
cmlenz
parents: 423
diff changeset
127 self._render_overview(req)
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
128
164
a9cddfae3c09 Adapt to Trac [http://projects.edgewall.com/trac/changeset/2132 r2132].
cmlenz
parents: 163
diff changeset
129 add_stylesheet(req, 'bitten/bitten.css')
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
130 return 'bitten_config.cs', None
64
de1a7499f4d6 Basic timeline provider for builds.
cmlenz
parents: 60
diff changeset
131
de1a7499f4d6 Basic timeline provider for builds.
cmlenz
parents: 60
diff changeset
132 # Internal methods
de1a7499f4d6 Basic timeline provider for builds.
cmlenz
parents: 60
diff changeset
133
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
134 def _render_overview(self, req):
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
135 req.hdf['title'] = 'Build Status'
209
d2b9c72e9643 Hide deactivated build configurations on the build status page by default, and provide an option panel to make them visible.
cmlenz
parents: 203
diff changeset
136 show_all = False
d2b9c72e9643 Hide deactivated build configurations on the build status page by default, and provide an option panel to make them visible.
cmlenz
parents: 203
diff changeset
137 if req.args.get('show') == 'all':
d2b9c72e9643 Hide deactivated build configurations on the build status page by default, and provide an option panel to make them visible.
cmlenz
parents: 203
diff changeset
138 show_all = True
d2b9c72e9643 Hide deactivated build configurations on the build status page by default, and provide an option panel to make them visible.
cmlenz
parents: 203
diff changeset
139 req.hdf['config.show_all'] = show_all
d2b9c72e9643 Hide deactivated build configurations on the build status page by default, and provide an option panel to make them visible.
cmlenz
parents: 203
diff changeset
140
255
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
141 configs = BuildConfig.select(self.env, include_inactive=show_all)
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
142 for idx, config in enumerate(configs):
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
143 prefix = 'configs.%d' % idx
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
144 description = config.description
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
145 if description:
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
146 description = wiki_to_html(description, self.env, req)
255
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
147 req.hdf[prefix] = {
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
148 'name': config.name, 'label': config.label or config.name,
209
d2b9c72e9643 Hide deactivated build configurations on the build status page by default, and provide an option panel to make them visible.
cmlenz
parents: 203
diff changeset
149 'active': config.active, 'path': config.path,
d2b9c72e9643 Hide deactivated build configurations on the build status page by default, and provide an option panel to make them visible.
cmlenz
parents: 203
diff changeset
150 'description': description,
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
151 'href': req.href.build(config.name),
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
152 }
255
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
153 if not config.active:
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
154 continue
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
155
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
156 repos = self.env.get_repository(req.authname)
360
5bc81e597352 Fix incompatibility with a change to the versioncontrol layer in Trac 0.10.3
cmlenz
parents: 328
diff changeset
157 if hasattr(repos, 'sync'):
5bc81e597352 Fix incompatibility with a change to the versioncontrol layer in Trac 0.10.3
cmlenz
parents: 328
diff changeset
158 repos.sync()
5bc81e597352 Fix incompatibility with a change to the versioncontrol layer in Trac 0.10.3
cmlenz
parents: 328
diff changeset
159
255
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
160 prev_rev = None
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
161 for platform, rev, build in collect_changes(repos, config):
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
162 if rev != prev_rev:
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
163 if prev_rev is None:
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
164 chgset = repos.get_changeset(rev)
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
165 req.hdf[prefix + '.youngest_rev'] = {
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
166 'id': rev, 'href': req.href.changeset(rev),
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
167 'author': chgset.author or 'anonymous',
255
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
168 'date': format_datetime(chgset.date),
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
169 'message': wiki_to_oneliner(
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
170 shorten_line(chgset.message), self.env)
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
171 }
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
172 else:
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
173 break
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
174 prev_rev = rev
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
175 if build:
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
176 build_hdf = _build_to_hdf(self.env, req, build)
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
177 build_hdf['platform'] = platform.name
256
aa942e2c7243 A bit of polishing for [265]: also show build if not yet in the queue, some layout improvements.
cmlenz
parents: 255
diff changeset
178 req.hdf[prefix + '.builds.%d' % platform.id] = build_hdf
aa942e2c7243 A bit of polishing for [265]: also show build if not yet in the queue, some layout improvements.
cmlenz
parents: 255
diff changeset
179 else:
aa942e2c7243 A bit of polishing for [265]: also show build if not yet in the queue, some layout improvements.
cmlenz
parents: 255
diff changeset
180 req.hdf[prefix + '.builds.%d' % platform.id] = {
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
181 'platform': platform.name, 'status': 'pending'
256
aa942e2c7243 A bit of polishing for [265]: also show build if not yet in the queue, some layout improvements.
cmlenz
parents: 255
diff changeset
182 }
255
42f555e1d648 Show the build status for the latest changeset for every build configuration on the main build status page. Closes #21.
cmlenz
parents: 250
diff changeset
183
123
cccfa117e344 Template cleanup
cmlenz
parents: 120
diff changeset
184 req.hdf['page.mode'] = 'overview'
436
cfbc9ee622d5 Finish the move of build configuration management into the admin interface.
cmlenz
parents: 423
diff changeset
185 add_link(req, 'views', req.href.build(view='inprogress'),
cfbc9ee622d5 Finish the move of build configuration management into the admin interface.
cmlenz
parents: 423
diff changeset
186 'In Progress Builds')
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
187
381
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
188 def _render_inprogress(self, req):
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
189 req.hdf['title'] = 'In Progress Builds'
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
190
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
191 db = self.env.get_db_cnx()
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
192
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
193 configs = BuildConfig.select(self.env, include_inactive=False)
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
194 for idx, config in enumerate(configs):
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
195 if not config.active:
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
196 continue
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
197
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
198 in_progress_builds = Build.select(self.env, config=config.name,
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
199 status=Build.IN_PROGRESS, db=db)
437
6d5ac24061dc Fix build queue population compatiblity with Trac 0.11, where revision timestamps are `datetime` objects.
cmlenz
parents: 436
diff changeset
200
381
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
201 # sort correctly by revision.
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
202 builds = list(in_progress_builds)
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
203 builds.sort(lambda x, y: int(y.rev) - int(x.rev))
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
204 prefix = 'configs.%d' % idx
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
205
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
206 current_builds = 0
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
207 for idx2, build in enumerate(builds):
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
208 prefix2 = '%s.builds.%d' % (prefix, idx2)
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
209 rev = build.rev
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
210 req.hdf[prefix2] = _build_to_hdf(self.env, req, build)
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
211 req.hdf[prefix2 + '.rev'] = rev
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
212 req.hdf[prefix2 + '.rev_href'] = self.env.href.changeset(rev)
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
213 platform = TargetPlatform.fetch(self.env, build.platform)
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
214 req.hdf[prefix2 + '.platform'] = platform.name
437
6d5ac24061dc Fix build queue population compatiblity with Trac 0.11, where revision timestamps are `datetime` objects.
cmlenz
parents: 436
diff changeset
215
381
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
216 for step in BuildStep.select(self.env, build=build.id, db=db):
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
217 req.hdf['%s.steps.%s' % (prefix2, step.name)] = {
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
218 'description': step.description,
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
219 'duration': datetime.fromtimestamp(step.stopped) - \
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
220 datetime.fromtimestamp(step.started),
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
221 'failed': not step.successful,
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
222 'errors': step.errors,
437
6d5ac24061dc Fix build queue population compatiblity with Trac 0.11, where revision timestamps are `datetime` objects.
cmlenz
parents: 436
diff changeset
223 'href': req.hdf[prefix2 + '.href'] + '#step_' + step.name
6d5ac24061dc Fix build queue population compatiblity with Trac 0.11, where revision timestamps are `datetime` objects.
cmlenz
parents: 436
diff changeset
224 }
381
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
225
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
226 current_builds = current_builds + 1
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
227
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
228 if current_builds == 0:
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
229 continue
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
230
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
231 description = config.description
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
232 if description:
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
233 description = wiki_to_html(description, self.env, req)
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
234 req.hdf[prefix] = {
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
235 'name': config.name, 'label': config.label or config.name,
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
236 'active': config.active, 'path': config.path,
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
237 'description': description,
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
238 'href': self.env.href.build(config.name),
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
239 }
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
240
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
241 req.hdf['page.mode'] = 'view_inprogress'
166dcdb9269e New In-Progress Builds Page, which lists the current builds that are being processed by slaves. Accessible from the main build page.
wbell
parents: 379
diff changeset
242
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
243 def _render_config(self, req, config_name):
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
244 db = self.env.get_db_cnx()
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
245
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
246 config = BuildConfig.fetch(self.env, config_name, db=db)
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
247 req.hdf['title'] = 'Build Configuration "%s"' \
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
248 % config.label or config.name
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
249 add_link(req, 'up', req.href.build(), 'Build Status')
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
250 description = config.description
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
251 if description:
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
252 description = wiki_to_html(description, self.env, req)
123
cccfa117e344 Template cleanup
cmlenz
parents: 120
diff changeset
253 req.hdf['config'] = {
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
254 'name': config.name, 'label': config.label, 'path': config.path,
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
255 'min_rev': config.min_rev,
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
256 'min_rev_href': req.href.changeset(config.min_rev),
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
257 'max_rev': config.max_rev,
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
258 'max_rev_href': req.href.changeset(config.max_rev),
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
259 'active': config.active, 'description': description,
436
cfbc9ee622d5 Finish the move of build configuration management into the admin interface.
cmlenz
parents: 423
diff changeset
260 'browser_href': req.href.browser(config.path)
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
261 }
123
cccfa117e344 Template cleanup
cmlenz
parents: 120
diff changeset
262 req.hdf['page.mode'] = 'view_config'
47
083e848088ee * Improvements to the model classes, and a couple of unit tests.
cmlenz
parents: 45
diff changeset
263
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
264 platforms = list(TargetPlatform.select(self.env, config=config_name,
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
265 db=db))
123
cccfa117e344 Template cleanup
cmlenz
parents: 120
diff changeset
266 req.hdf['config.platforms'] = [
76
ffa1ffd8c7db * Implement basic slave selection based on configured target platforms. Closes #15.
cmlenz
parents: 74
diff changeset
267 {'name': platform.name, 'id': platform.id} for platform in platforms
ffa1ffd8c7db * Implement basic slave selection based on configured target platforms. Closes #15.
cmlenz
parents: 74
diff changeset
268 ]
74
1d4fa4c32afa Add template and static resources, hooked up using the new {{{ITemplateProvider}}} extension point in Trac.
cmlenz
parents: 73
diff changeset
269
197
d72c0587fae9 * Don't schedule/display builds for revisions where the repository directory is empty. Fixes #46.
cmlenz
parents: 196
diff changeset
270 has_reports = False
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
271 for report in Report.select(self.env, config=config.name, db=db):
197
d72c0587fae9 * Don't schedule/display builds for revisions where the repository directory is empty. Fixes #46.
cmlenz
parents: 196
diff changeset
272 has_reports = True
d72c0587fae9 * Don't schedule/display builds for revisions where the repository directory is empty. Fixes #46.
cmlenz
parents: 196
diff changeset
273 break
d72c0587fae9 * Don't schedule/display builds for revisions where the repository directory is empty. Fixes #46.
cmlenz
parents: 196
diff changeset
274
d72c0587fae9 * Don't schedule/display builds for revisions where the repository directory is empty. Fixes #46.
cmlenz
parents: 196
diff changeset
275 if has_reports:
388
3ba9430a5d87 Fix for hardcoded chart generators in UI. Closes #153.
cmlenz
parents: 382
diff changeset
276 chart_generators = []
391
7801dddec1a1 Sign, another follow-up to [438]. One of these days I should get it right :-(
cmlenz
parents: 390
diff changeset
277 for generator in ReportChartController(self.env).generators:
388
3ba9430a5d87 Fix for hardcoded chart generators in UI. Closes #153.
cmlenz
parents: 382
diff changeset
278 for category in generator.get_supported_categories():
3ba9430a5d87 Fix for hardcoded chart generators in UI. Closes #153.
cmlenz
parents: 382
diff changeset
279 chart_generators.append({
3ba9430a5d87 Fix for hardcoded chart generators in UI. Closes #153.
cmlenz
parents: 382
diff changeset
280 'href': req.href.build(config.name, 'chart/' + category)
3ba9430a5d87 Fix for hardcoded chart generators in UI. Closes #153.
cmlenz
parents: 382
diff changeset
281 })
3ba9430a5d87 Fix for hardcoded chart generators in UI. Closes #153.
cmlenz
parents: 382
diff changeset
282 req.hdf['config.charts'] = chart_generators
197
d72c0587fae9 * Don't schedule/display builds for revisions where the repository directory is empty. Fixes #46.
cmlenz
parents: 196
diff changeset
283 charts_license = self.config.get('bitten', 'charts_license')
d72c0587fae9 * Don't schedule/display builds for revisions where the repository directory is empty. Fixes #46.
cmlenz
parents: 196
diff changeset
284 if charts_license:
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
285 req.hdf['config.charts_license'] = charts_license
178
fcbe107ca755 Add some basic charts to the build status page, based on [http://www.maani.us/xml_charts/index.php XML/SWF Charts]:
cmlenz
parents: 174
diff changeset
286
214
f0e37bee64c5 Paging on build configuration page. Closes #24.
cmlenz
parents: 213
diff changeset
287 page = max(1, int(req.args.get('page', 1)))
f0e37bee64c5 Paging on build configuration page. Closes #24.
cmlenz
parents: 213
diff changeset
288 more = False
f0e37bee64c5 Paging on build configuration page. Closes #24.
cmlenz
parents: 213
diff changeset
289 req.hdf['page.number'] = page
f0e37bee64c5 Paging on build configuration page. Closes #24.
cmlenz
parents: 213
diff changeset
290
360
5bc81e597352 Fix incompatibility with a change to the versioncontrol layer in Trac 0.10.3
cmlenz
parents: 328
diff changeset
291 repos = self.env.get_repository(req.authname)
5bc81e597352 Fix incompatibility with a change to the versioncontrol layer in Trac 0.10.3
cmlenz
parents: 328
diff changeset
292 if hasattr(repos, 'sync'):
5bc81e597352 Fix incompatibility with a change to the versioncontrol layer in Trac 0.10.3
cmlenz
parents: 328
diff changeset
293 repos.sync()
5bc81e597352 Fix incompatibility with a change to the versioncontrol layer in Trac 0.10.3
cmlenz
parents: 328
diff changeset
294
228
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
295 builds_per_page = 12 * len(platforms)
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
296 idx = 0
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
297 for platform, rev, build in collect_changes(repos, config):
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
298 if idx >= page * builds_per_page:
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
299 more = True
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
300 break
232
b6e4896dc026 Fix regression introduced in [239]: first build was being skipped on build configuration page.
cmlenz
parents: 230
diff changeset
301 elif idx >= (page - 1) * builds_per_page:
230
c7ff953ebb07 Fix paging on build configuration page. Closes #55.
cmlenz
parents: 228
diff changeset
302 prefix = 'config.builds.%d' % rev
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
303 req.hdf[prefix + '.href'] = req.href.changeset(rev)
230
c7ff953ebb07 Fix paging on build configuration page. Closes #55.
cmlenz
parents: 228
diff changeset
304 if build and build.status != Build.PENDING:
c7ff953ebb07 Fix paging on build configuration page. Closes #55.
cmlenz
parents: 228
diff changeset
305 build_hdf = _build_to_hdf(self.env, req, build)
c7ff953ebb07 Fix paging on build configuration page. Closes #55.
cmlenz
parents: 228
diff changeset
306 req.hdf['%s.%s' % (prefix, platform.id)] = build_hdf
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
307 for step in BuildStep.select(self.env, build=build.id,
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
308 db=db):
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
309 req.hdf['%s.%s.steps.%s' % (prefix, platform.id,
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
310 step.name)] = {
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
311 'description': step.description,
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
312 'duration': datetime.fromtimestamp(step.stopped) - \
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
313 datetime.fromtimestamp(step.started),
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
314 'failed': not step.successful,
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
315 'errors': step.errors,
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
316 'href': build_hdf['href'] + '#step_' + step.name,
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
317 }
230
c7ff953ebb07 Fix paging on build configuration page. Closes #55.
cmlenz
parents: 228
diff changeset
318 idx += 1
214
f0e37bee64c5 Paging on build configuration page. Closes #24.
cmlenz
parents: 213
diff changeset
319
228
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
320 if page > 1:
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
321 if page == 2:
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
322 prev_href = req.href.build(config.name)
228
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
323 else:
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
324 prev_href = req.href.build(config.name, page=page - 1)
228
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
325 add_link(req, 'prev', prev_href, 'Previous Page')
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
326 if more:
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
327 next_href = req.href.build(config.name, page=page + 1)
228
a8c9dd7e3f71 * Cleanup and documentation for the `BuildQueue` class added in [236].
cmlenz
parents: 219
diff changeset
328 add_link(req, 'next', next_href, 'Next Page')
41
16b30ffc5fb9 Add web interface for viewing and managing build configurations. Closes #9.
cmlenz
parents: 35
diff changeset
329
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
330
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
331 class BuildController(Component):
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
332 """Renders the build page."""
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
333 implements(INavigationContributor, IRequestHandler, ITimelineEventProvider)
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
334
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
335 log_formatters = ExtensionPoint(ILogFormatter)
161
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
336 report_summarizers = ExtensionPoint(IReportSummarizer)
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
337
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
338 # INavigationContributor methods
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
339
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
340 def get_active_navigation_item(self, req):
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
341 return 'build'
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
342
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
343 def get_navigation_items(self, req):
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
344 return []
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
345
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
346 # IRequestHandler methods
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
347
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
348 def match_request(self, req):
174
79c61c26a4e1 * Changed the `IReportStore` interface to allow querying with [http://www.w3.org/XML/Query/ XQuery]. This should make it possible to efficiently query the report store for any existing metrics.
cmlenz
parents: 168
diff changeset
349 match = re.match(r'/build/([\w.-]+)/(\d+)', req.path_info)
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
350 if match:
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
351 if match.group(1):
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
352 req.args['config'] = match.group(1)
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
353 if match.group(2):
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
354 req.args['id'] = match.group(2)
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
355 return True
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
356
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
357 def process_request(self, req):
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
358 req.perm.assert_permission('BUILD_VIEW')
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
359
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
360 db = self.env.get_db_cnx()
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
361 build_id = int(req.args.get('id'))
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
362 build = Build.fetch(self.env, build_id, db=db)
96
c8c36f34ff5a Change model class pattern:
cmlenz
parents: 91
diff changeset
363 assert build, 'Build %s does not exist' % build_id
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
364
184
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
365 if req.method == 'POST':
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
366 if req.args.get('action') == 'invalidate':
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
367 self._do_invalidate(req, build, db)
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
368 req.redirect(req.href.build(build.config, build.id))
184
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
369
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
370 add_link(req, 'up', req.href.build(build.config),
73
6d7753ea1798 Implemented basic management of target platforms. Closes #14.
cmlenz
parents: 69
diff changeset
371 'Build Configuration')
91
91db738c6a74 Fix status display for in-progress builds.
cmlenz
parents: 82
diff changeset
372 status2title = {Build.SUCCESS: 'Success', Build.FAILURE: 'Failure',
91db738c6a74 Fix status display for in-progress builds.
cmlenz
parents: 82
diff changeset
373 Build.IN_PROGRESS: 'In Progress'}
69
b92d7c7d70fd Record build slave properties in database.
cmlenz
parents: 67
diff changeset
374 req.hdf['title'] = 'Build %s - %s' % (build_id,
b92d7c7d70fd Record build slave properties in database.
cmlenz
parents: 67
diff changeset
375 status2title[build.status])
123
cccfa117e344 Template cleanup
cmlenz
parents: 120
diff changeset
376 req.hdf['page.mode'] = 'view_build'
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
377 config = BuildConfig.fetch(self.env, build.config, db=db)
69
b92d7c7d70fd Record build slave properties in database.
cmlenz
parents: 67
diff changeset
378 req.hdf['build.config'] = {
b92d7c7d70fd Record build slave properties in database.
cmlenz
parents: 67
diff changeset
379 'name': config.label,
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
380 'href': req.href.build(config.name)
69
b92d7c7d70fd Record build slave properties in database.
cmlenz
parents: 67
diff changeset
381 }
b92d7c7d70fd Record build slave properties in database.
cmlenz
parents: 67
diff changeset
382
258
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
383 formatters = []
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
384 for formatter in self.log_formatters:
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
385 formatters.append(formatter.get_formatter(req, build))
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
386
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
387 summarizers = {} # keyed by report type
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
388 for summarizer in self.report_summarizers:
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
389 categories = summarizer.get_supported_categories()
423
8864b3917221 Fix for Python 2.3 incompatibility in display for report summaries. Closes #164.
cmlenz
parents: 411
diff changeset
390 summarizers.update(dict([(cat, summarizer) for cat in categories]))
258
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
391
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
392 req.hdf['build'] = _build_to_hdf(self.env, req, build)
80
dc1c7fc9b915 Record the output of build steps in the database. See #12. Still need to get better granularity in transmitting the log output from slave to master before #12 can be closed.
cmlenz
parents: 79
diff changeset
393 steps = []
112
a38eabd4b6e1 * Store build logs in a structured way, for example to highlight messages on the error stream.
cmlenz
parents: 111
diff changeset
394 for step in BuildStep.select(self.env, build=build.id, db=db):
80
dc1c7fc9b915 Record the output of build steps in the database. See #12. Still need to get better granularity in transmitting the log output from slave to master before #12 can be closed.
cmlenz
parents: 79
diff changeset
395 steps.append({
dc1c7fc9b915 Record the output of build steps in the database. See #12. Still need to get better granularity in transmitting the log output from slave to master before #12 can be closed.
cmlenz
parents: 79
diff changeset
396 'name': step.name, 'description': step.description,
123
cccfa117e344 Template cleanup
cmlenz
parents: 120
diff changeset
397 'duration': pretty_timedelta(step.started, step.stopped),
161
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
398 'failed': step.status == BuildStep.FAILURE,
245
a22ec8fce6c9 Store the reason(s) for build step failure in the database.
cmlenz
parents: 232
diff changeset
399 'errors': step.errors,
258
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
400 'log': self._render_log(req, build, formatters, step),
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
401 'reports': self._render_reports(req, config, build, summarizers,
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
402 step)
80
dc1c7fc9b915 Record the output of build steps in the database. See #12. Still need to get better granularity in transmitting the log output from slave to master before #12 can be closed.
cmlenz
parents: 79
diff changeset
403 })
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
404 req.hdf['build.steps'] = steps
184
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
405 req.hdf['build.can_delete'] = req.perm.has_permission('BUILD_DELETE')
120
b63ed684c29c Show the list of reports generated on the build page.
cmlenz
parents: 114
diff changeset
406
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
407 repos = self.env.get_repository(req.authname)
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
408 chgset = repos.get_changeset(build.rev)
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
409 req.hdf['build.chgset_author'] = chgset.author
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
410
164
a9cddfae3c09 Adapt to Trac [http://projects.edgewall.com/trac/changeset/2132 r2132].
cmlenz
parents: 163
diff changeset
411 add_stylesheet(req, 'bitten/bitten.css')
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
412 return 'bitten_build.cs', None
80
dc1c7fc9b915 Record the output of build steps in the database. See #12. Still need to get better granularity in transmitting the log output from slave to master before #12 can be closed.
cmlenz
parents: 79
diff changeset
413
141
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
414 # ITimelineEventProvider methods
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
415
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
416 def get_timeline_filters(self, req):
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
417 if req.perm.has_permission('BUILD_VIEW'):
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
418 yield ('build', 'Builds')
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
419
0e21778c04ef Refactoring: split up the components and templates that render the web interface.
cmlenz
parents: 139
diff changeset
420 def get_timeline_events(self, req, start, stop, filters):
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
421 if 'build' not in filters:
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
422 return
250
0271a2b1fc23 Improvements to the web interface:
cmlenz
parents: 247
diff changeset
423
382
2078b20186cf Trac 0.11 compatibility fix in timeline event provider.
cmlenz
parents: 381
diff changeset
424 if isinstance(start, datetime): # Trac>=0.11
2078b20186cf Trac 0.11 compatibility fix in timeline event provider.
cmlenz
parents: 381
diff changeset
425 from trac.util.datefmt import to_timestamp
2078b20186cf Trac 0.11 compatibility fix in timeline event provider.
cmlenz
parents: 381
diff changeset
426 start = to_timestamp(start)
2078b20186cf Trac 0.11 compatibility fix in timeline event provider.
cmlenz
parents: 381
diff changeset
427 stop = to_timestamp(stop)
2078b20186cf Trac 0.11 compatibility fix in timeline event provider.
cmlenz
parents: 381
diff changeset
428
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
429 add_stylesheet(req, 'bitten/bitten.css')
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
430
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
431 db = self.env.get_db_cnx()
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
432 cursor = db.cursor()
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
433 cursor.execute("SELECT b.id,b.config,c.label,b.rev,p.name,"
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
434 "b.stopped,b.status FROM bitten_build AS b"
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
435 " INNER JOIN bitten_config AS c ON (c.name=b.config) "
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
436 " INNER JOIN bitten_platform AS p ON (p.id=b.platform) "
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
437 "WHERE b.stopped>=%s AND b.stopped<=%s "
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
438 "AND b.status IN (%s, %s) ORDER BY b.stopped",
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
439 (start, stop, Build.SUCCESS, Build.FAILURE))
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
440
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
441 event_kinds = {Build.SUCCESS: 'successbuild',
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
442 Build.FAILURE: 'failedbuild'}
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
443 for id, config, label, rev, platform, stopped, status in cursor:
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
444
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
445 errors = []
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
446 if status == Build.FAILURE:
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
447 for step in BuildStep.select(self.env, build=id,
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
448 status=BuildStep.FAILURE,
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
449 db=db):
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
450 errors += [(step.name, error) for error
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
451 in step.errors]
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
452
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
453 title = Markup('Build of <em>%s [%s]</em> on %s %s', label, rev,
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
454 platform, _status_label[status])
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
455 message = ''
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
456 if req.args.get('format') == 'rss':
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
457 href = self.env.abs_href.build(config, id)
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
458 if errors:
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
459 buf = StringIO()
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
460 prev_step = None
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
461 for step, error in errors:
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
462 if step != prev_step:
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
463 if prev_step is not None:
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
464 buf.write('</ul>')
321
8e8d40d50001 Removed too much of the escaping in [333].
cmlenz
parents: 320
diff changeset
465 buf.write('<p>Step %s failed:</p><ul>' \
8e8d40d50001 Removed too much of the escaping in [333].
cmlenz
parents: 320
diff changeset
466 % escape(step))
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
467 prev_step = step
321
8e8d40d50001 Removed too much of the escaping in [333].
cmlenz
parents: 320
diff changeset
468 buf.write('<li>%s</li>' % escape(error))
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
469 buf.write('</ul>')
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
470 message = Markup(buf.getvalue())
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
471 else:
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
472 href = req.href.build(config, id)
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
473 if errors:
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
474 steps = []
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
475 for step, error in errors:
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
476 if step not in steps:
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
477 steps.append(step)
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
478 steps = [Markup('<em>%s</em>', step) for step in steps]
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
479 if len(steps) < 2:
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
480 message = steps[0]
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
481 elif len(steps) == 2:
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
482 message = Markup(' and ').join(steps)
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
483 elif len(steps) > 2:
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
484 message = Markup(', ').join(steps[:-1]) + ', and ' + \
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
485 steps[-1]
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
486 message = Markup('Step%s %s failed',
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
487 len(steps) != 1 and 's' or '', message)
311
7f6fc38e14ff More assertions in `Build` model methods.
cmlenz
parents: 295
diff changeset
488 yield event_kinds[status], href, title, stopped, None, message
114
ecc062d4fd55 Paths to files and directories in the build log output are rendered as links to the repository browser.
cmlenz
parents: 112
diff changeset
489
161
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
490 # Internal methods
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
491
184
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
492 def _do_invalidate(self, req, build, db):
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
493 self.log.info('Invalidating build %d', build.id)
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
494
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
495 for step in BuildStep.select(self.env, build=build.id, db=db):
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
496 step.delete(db=db)
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
497
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
498 build.slave = None
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
499 build.started = build.stopped = 0
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
500 build.status = Build.PENDING
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
501 build.slave_info = {}
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
502 build.update()
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
503
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
504 db.commit()
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
505
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
506 req.redirect(req.href.build(build.config))
184
fbf949f4c706 Allow invalidation of builds from the web interface. This results in the build being reset to ''PENDING'' status, and all build logs, slave information and reports deleted. Basically initiates a rebuild for a specific revision and target platform.
cmlenz
parents: 182
diff changeset
507
258
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
508 def _render_log(self, req, build, formatters, step):
161
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
509 items = []
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
510 for log in BuildLog.select(self.env, build=build.id, step=step.name):
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
511 for level, message in log.messages:
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
512 for format in formatters:
258
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
513 message = format(step, log.generator, level, message)
161
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
514 items.append({'level': level, 'message': message})
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
515 return items
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
516
258
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
517 def _render_reports(self, req, config, build, summarizers, step):
161
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
518 reports = []
203
e6ddca1e5712 Huge refactoring to remove dependency on BDB XML. Report data is now stored in the Trac database (SQLite/PostgreSQL).
cmlenz
parents: 200
diff changeset
519 for report in Report.select(self.env, build=build.id, step=step.name):
e6ddca1e5712 Huge refactoring to remove dependency on BDB XML. Report data is now stored in the Trac database (SQLite/PostgreSQL).
cmlenz
parents: 200
diff changeset
520 summarizer = summarizers.get(report.category)
161
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
521 if summarizer:
213
25f84dd9f159 * Refactoring of build recipes, the file format has changed slightly:
cmlenz
parents: 209
diff changeset
522 summary = summarizer.render_summary(req, config, build, step,
203
e6ddca1e5712 Huge refactoring to remove dependency on BDB XML. Report data is now stored in the Trac database (SQLite/PostgreSQL).
cmlenz
parents: 200
diff changeset
523 report.category)
161
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
524 else:
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
525 summary = None
320
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
526 reports.append({'category': report.category,
a8b713254286 Fixes for compatibility with Trac trunk and 0.9.3.
cmlenz
parents: 318
diff changeset
527 'summary': Markup(summary)})
161
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
528 return reports
4677161d2ae9 Reports can now be "summarized" on the build results page, with special components rendering summary HTML fragments for specific report types. The summaries are displayed as tabs next to the log of the build step. Currently summarizers for test results and code coverage exist.
cmlenz
parents: 147
diff changeset
529
114
ecc062d4fd55 Paths to files and directories in the build log output are rendered as links to the repository browser.
cmlenz
parents: 112
diff changeset
530
409
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
531 class ReportChartController(Component):
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
532 implements(IRequestHandler)
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
533
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
534 generators = ExtensionPoint(IReportChartGenerator)
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
535
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
536 # IRequestHandler methods
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
537
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
538 def match_request(self, req):
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
539 match = re.match(r'/build/([\w.-]+)/chart/(\w+)', req.path_info)
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
540 if match:
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
541 req.args['config'] = match.group(1)
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
542 req.args['category'] = match.group(2)
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
543 return True
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
544
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
545 def process_request(self, req):
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
546 category = req.args.get('category')
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
547 config = BuildConfig.fetch(self.env, name=req.args.get('config'))
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
548
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
549 for generator in self.generators:
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
550 if category in generator.get_supported_categories():
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
551 template = generator.generate_chart_data(req, config,
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
552 category)
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
553 break
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
554 else:
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
555 raise TracError('Unknown report category "%s"' % category)
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
556
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
557 return template, 'text/xml'
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
558
5786700df0c7 Moved/restructured the modules implementing report chart generators and report summarizers.
cmlenz
parents: 408
diff changeset
559
114
ecc062d4fd55 Paths to files and directories in the build log output are rendered as links to the repository browser.
cmlenz
parents: 112
diff changeset
560 class SourceFileLinkFormatter(Component):
258
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
561 """Detects references to files in the build log and renders them as links
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
562 to the repository browser."""
203
e6ddca1e5712 Huge refactoring to remove dependency on BDB XML. Report data is now stored in the Trac database (SQLite/PostgreSQL).
cmlenz
parents: 200
diff changeset
563
114
ecc062d4fd55 Paths to files and directories in the build log output are rendered as links to the repository browser.
cmlenz
parents: 112
diff changeset
564 implements(ILogFormatter)
ecc062d4fd55 Paths to files and directories in the build log output are rendered as links to the repository browser.
cmlenz
parents: 112
diff changeset
565
258
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
566 _fileref_re = re.compile('(?P<path>[\w.-]+(?:/[\w.-]+)+)(?P<line>(:\d+))')
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
567
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
568 def get_formatter(self, req, build):
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
569 """Return the log message formatter function."""
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
570 config = BuildConfig.fetch(self.env, name=build.config)
114
ecc062d4fd55 Paths to files and directories in the build log output are rendered as links to the repository browser.
cmlenz
parents: 112
diff changeset
571 repos = self.env.get_repository(req.authname)
376
05c684ceb8c6 Use `req.href` instead of `env.href` as that works much better in Trac>=0.10. That also means Trac 0.9 is no longer supported.
cmlenz
parents: 362
diff changeset
572 href = req.href.browser
258
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
573 cache = {}
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
574 def _replace(m):
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
575 filepath = posixpath.normpath(m.group('path').replace('\\', '/'))
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
576 if not cache.get(filepath) is True:
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
577 parts = filepath.split('/')
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
578 path = ''
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
579 for part in parts:
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
580 path = posixpath.join(path, part)
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
581 if not path in cache:
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
582 try:
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
583 repos.get_node(posixpath.join(config.path, path),
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
584 build.rev)
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
585 cache[path] = True
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
586 except TracError:
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
587 cache[path] = False
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
588 if cache[path] is False:
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
589 return m.group(0)
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
590 return '<a href="%s">%s</a>' % (
263
688501d1d342 * Fix links in build log formatter.
cmlenz
parents: 262
diff changeset
591 href(config.path, filepath) + '#L' + m.group('line')[1:],
258
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
592 m.group(0))
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
593 def _formatter(step, type, level, message):
77cdef044d48 * Improve build log formatter performance: now only matches strings using the `path:line` format, and checks the existance of files in the repository when they are encountered. Should fix (or at least improve) #54.
cmlenz
parents: 256
diff changeset
594 return self._fileref_re.sub(_replace, message)
114
ecc062d4fd55 Paths to files and directories in the build log output are rendered as links to the repository browser.
cmlenz
parents: 112
diff changeset
595 return _formatter
Copyright (C) 2012-2017 Edgewall Software