Simscope Release History

How to upgrade?

Note: to upgrade your Simscope or Tunnel version, please follow the Upgrade instructions.

→ See also Tunnel Release History

1.528

1. `feature` Added support for uniqueid Live publishing

This release adds a simpler Live job matching algorithm based on a uniqueid job field.

2. `feature` Chart: added Group By: Run Group

Charts can now be grouped by Run Group.

3. `bugfix` Fixed incorrect Score calculation of Aborted regression results

In previous releases, regressions with missing/lost jobs may show an incorrect Score (e.g. 100%), even if the regression contained lost jobs.

Now the score automatically includes aborted/lost jobs.

4. `bugfix` Fixed Project Component view with empty components

If Components have no matching jobs inside the Projects page, they now show up grouped under an Empty sub-group, to clarify why they show up as faded out.

5. `feature` Added Chart configuration: seriesstrippatterns

SIMSCOPE-141

Charts now have an optional configuration seriesstrippatterns, which is a list of optional regular expressions, allowing shortening of long series names, when rendering charts.

For example, if you have a long regression called my/super/long/regression/daily/snake/202, you can add this to your simscope.config to remove the long prefix:

[chart]
# Strip series patterns when rendering charts (regular expressions).
# Example: strip pattern: [my ... daily/]
seriesstrippatterns = "^my.*daily/"
# Also strip 'projectA' (anywhere)
seriesstrippatterns = "projectA"

6. `bugfix` Fixed a regex Build filter bug

Fixed a bug in regression search where regex field was not propagating when drilling into regression details links.

7. `feature` Upgraded compile toolchain

This release updates the compile toolchain, requring a minimum Linux OS, equivalent to RedHat7 or higher.

1.527

1. `bugfix` Regression grouped view pagination fix

In previous releases, when grouping regressions by Component, Series, etc., the summary view could paginate to a single page, containing the first matching 50 regressions incorrectly.

This resulted in an invalid summary view that was missing records.

This bug is now fixed, so that the summary page should summarize based on 1000 records.

2. `bugfix` Fixed double-metrics-reindex bug

In previous releases, reindex could be scheduled simultaneously in parallel.

1.526

`feature` Added merge for formal coverage

Formal coverage DB's can now be merged together.

Note: identical property names are combined as siblings, rather than merged into a single property.

1.525

1. `feature` GUI simscope.config editor

The simscope.config can now be edited and saved to disk from within the Simscope GUI, to allow easier configuration changes without needing a terminal.

2. `feature` Metrics DB incremental updates

The Metrics DB now supports incremental updates, upon a regression finishing (or timing out).

Charts should now be fresh for all non-live regressions.

Note: this requires a one-time table reindex after installing this release:

Click Admin Lock → Repopulate Metrics Table
be patient: this could take a few hours

3. `bugfix` Chart wide-legend-table

The legend table now automatically shrinks to adjust to the size of the series names in the chart.

In previous releases, this used a fixed width, which could be too wide if there were short series names.

1.524

`feature` New Projects tab

This release contains a new Projects tab, to allow simplified drilldown navigation:

Project → Component → Regression.

1.523

1. `feature` Triage percentage collapse algorithm

The Triage calculation has been changed, so that if a signature has been split into:

NEW + ASSIGNED

Then the triage percentage will merge {NEW+ASSIGNED} together (instead of having separate counts).

This results in a slightly higher Triage % score.

Note: when calculating the Assignment %, NEW and ASSIGNED counts are both used separately. So the score is the same as previous versions.

2. `bugfix` 100% charts

Line Charts with a fixed 100% value now render with 100% values at the top of the chart instead of the middle.

3. `bugfix` Blank charts

Charts with empty datasets now render as a blank/empty chart, instead of showing an error message.

4. `feature` SMTP CA Certificates

Added SMTP CA Certificates configuration option, to allow custom X.509 certificates.

1.522

`feature` Regression plugins can now be dynamic

Regression plugins can now be dynamic, so you can save a search that only matches the latest run in a branch/component/etc.

Then when the next regression matching arrives, the plugin will execute against it instead.

1.521

1. `feature`Regression search by Updated timestamp

Regressions can now be searched by dates using the Update timestamp.

This allows finding regressions which were run a while ago, but have been updated with coverage or metadata values.

2. `feature` LDAP dndisablepattern

Added dndisablepattern to the LDAP configuration to allow user disabling based on their DN (Designated Name) value.

This feature enables automatically disabling users in Simscope (and free up license seats).

Example:

[ldap]
# Optional: DN Disable Pattern: If your organization disables LDAP users by changing their DN
#           (Designated Name), this variable allows a regular expression to auto-disable a user.
# Note: this requires 'directoryrefresh' to trigger.
#
# Here is an example where users get moved into the OU (Organizational Unit) called Disabled Users:
dndisablepattern = "OU=Disabled Users"

# Refresh the user directory every 24 hours
directoryrefresh = "24h"

3. `feature` Component Dashboard default

The Component details page now defaults to the component metrics/dashboard view.

4. `feature` Improved isoweek display

When choosing work week display, Simscope will show a placeholder with the low/high dates automatically.

5. `feature`Added Average Regression Runtime to homepage

The homepage now shows average regression runtime for each component.

6. `bugfix`Fixed display of long branch names

Long branch names are now line-wrapped in tables.

Previously these long names would expand tables very wide.

1.520

1. `bugfix` Fixed simscope-jira-create active bug logic detection

simscope-jira-create.py now has better Active Bug logic.

2. `feature` Improved job update performance

Job update DB performance has been improved, for large triage updates, by up to 20%.

3. `feature` Binary integer comparison

Integer values can now be compared with binary syntax.

For example, this searches for a 4-bit value in a metadata field:

perf_reg_int = 0b1101

4. `feature` New bitwise job metadata slicing

SIMSCOPE-80

Integer-based job metadata fields can now be bitwise indexed (for Rules or searches).

Example:

my_csr01[6:1] < 0x1a

This slices the my_csr01 metadata fields on the bits 6..1 and compares against hex value 0x1a

This expression would be equivalent to shifting my_csr01 by one bit and AND-ing the result with `0b

5. `feature` Added automatic DB integrity check

This now runs an hourly integrity check, and will pause RabbitMQ if the integrity check fails.

To disable the integrity check (not recommended):

[server]
# Skip automatic integrity check (NOT RECOMMENDED)
# skipintegritycheck = true

1.519

1. `feature` Added Global Age column in Signature table

The Signature table now shows a new column Global Age, in addition to the Window First Seen column.

This also allows sorting by Age, to show the oldest or newest Signature.

2. `feature` Added Timezone into Daily/Weekly charts

For Daily and Weekly charts, Simscope now prints the server timezone, to clarify to the users that the chart may be rendered in a timezone different than their local browser client timezone.

3. `feature` Replaced simscope-test-args with simscope-option-summary

The simscope-test-args Regression Plugin has been renamed to simcope-option-summary and has a batch of display improvements:

4. `bugfix` Fixed SMTP hang bug during shutdown

If network is interrupted, in previous releases, shutdown could hang waiting on SMTP.

This bug is now fixed.

5. `bugfix` Fixed Dark mode bug found in ADO

In previous releases, Simscope embedded as iframe into ADO was showing black horizonal bars, for users with Dark mode profile enabled.

Note: Simscope does not support true dark mode currently.

1.518

1. `feature` Job Histogram: Colorized Pass vs Fail series (green/red)

The Job Histogram now renders histogram value bars in green/red colors, to indicate pass vs fail.

Example:

2. `feature` Runtag separator splitting and drilldown

Regression Tags can now be separated by a string delimiter, to allow a list of runtags.

For example, if the separator is space, then the tag "cov daily" indicates two tags: run and daily.

Each tag is clickable from Simscope to allow drilldown.

3. `feature` Auto-refreshing Live regressions

Live regressions now auto-refresh within the web browser, as progress is made.

This allows users to monitor regression results, without clicking refresh.

4. `feature` Gsheets Testplan Template 0.1

New script simscope-gsheets-testplan.py to allow a Google Gsheets testplan template, score the result based on a Simscope regression, and store back into Simscope coverage DB.

This flow is currently alpha status, and under improvement.

5. `bugfix` Fixed a sub-model coverage bug

SIMSCOPE-135

Fixed a bug with ambiguous sub-model coverage.

6. `bugfix` Regression Series Latest: foo/$

Fixed a few pages to support Regression Latest Links via $.

This allows a fixed URL to auto-refresh from the latest regression matching a pattern.

7. `bugfix` JS fixed pie chart hover bug

Fixed a pie chart hover bug.

8. `bugfix` Job histogram bug: skips

In previous releases, the Job Histogram charts omitted skip results. These now are included.

1.517

`feature` New chart selection: Regression Metric Value (sum)

This release adds a new chart selection:

Regression Metric Value (sum)

This allows rendering summed (ie total) metric values across regressions.

As opposed to Regression Metric Value (average), which renders averaged values.

For example, if rendering a chart of the metric license_seats, you can render:

Total licenses used for a day
As opposed to Average licenses used per day

1.516

1. `feature` New Regression Series Drilldown/Grouping

This release includes an easier navigation and drilldown within Regression Search, to enable dynamic grouping of results by:

Component
Regression Name
Run Group
Branch
Model Version
or just a table list view

Example drilldown by run group, with totals:

2. `feature` Improved test list search pass/fail

Test list search table now shows jobs in green or red color, to indicate pass/fail status.

3. `feature` Regression DB archive/compress

Administrators can now Archive Regressions, which compresses DB disk usage by approximately 50%.

This process strips out job metadata fields from all pass jobs.
Fail jobs are not affected.

To execute, click the Archive (Compress) link.

Be patient, as this can be slow if many regressions are selected.

Also, be careful, as this removes data from your DB.

1.515

1. `feature` Added livetimeoutjoblimit option

Added livetimeoutjoblimit config variable to simscope.config, if you want to time out more than 500 Live Jobs per regression.

2. `feature` Added pagination to Live

Live job search results are now paginated.

3. `feature` Added primaryscorecategory option

Added primaryscorecategory config option to simscope.config, to show only a single Job Category in the Score (pass rate) for regression details.

For example, setting this to sim will show only simulation score at the top, rather than combined regression score including build, generation, etc.

4. `bugfix` Fixed scatter plot bug with +

SIMSCOPE-130

Scatter plots with regex-based regression searches are now working.

5. `feature` Improved display of Lost/Missing jobs

SIMSCOPE-131

Simscope now shows a Lost jobs column if there are lost/missing live jobs in a regression.

1.514

1. `feature` Improved metric charts in large browsers

Metric charts now automatically scale horizontally and vertically, to fit into large client web browser windows.

Previously charts had a fixed maximum size, so they may look small on large monitors.

2. `feature` Copy SHA to Clipboard

Users can now click on SHA (model versions) in Simscope to copy to full value of Model Version into the user's clipboard (for easy copy/paste).

For example, if a user clicks an abbreviated SHA abcdef in Simscope, it will copy abcdef1234567890 into their clipboard.

3. `bugfix` Live job timeout limit increased

SIMSCOPE-128

If a regression finishes with outstanding Live Jobs, Simscope will now convert up to 500 jobs into timeout errors.

Any remaining jobs will be left as live.

Previously it would only convert the first 100.

SIMSCOPE-129

In previous releases, if Simscope is embedded into iframe containers, it would print an incorrect warning about cookies into the browser window.

This bug is fixed.

5. `feature` Run Groups

Simscope can now show a List of Run Groups, which can be clicked to drilldown to view a list of regressions within that group.

This example shows a list of Weekly run groups:

6. `feature` Improved model-version charts

Rendering line charts with Time Period set to Model Version now render as scatter charts.

1.513

1. `bugfix` Fixed scatter plot limit bug

In previous releases, scatter plots were limited to 1000 data points. This has been increased to 5000, and if beyond that this will print an error message.

2. `bugfix` Added regression plugin output limit

Regression plugins are now limited to 10k lines of stdout output when executing, to prevent client browsers from hanging.

1.512

1. `bugfix` Fixed isoweek bug in Signatures

There was a bug in previous releases when using "This Work Week" or "Last Work Week" in the Signature search page.

2. `bugfix` Fixed ambiguity bug in sub-model-coverage

SIMSCOPE-126

Fixed a bug related to ambiguous regression and coverage model names.

For example, alpha.first.smoke/beta/12.fpu now resolves to:

Field	Value
Regression series	`alpha.first.smoke/beta`
Regression ID	`12`
Coverage model	`fpu`

1.511

1. `bugfix` Fixed a negative Live Job runtime bug

SIMSCOPE-125

When publishing Live jobs, Simscope now checks that the job JSON start timestamp is no more than one minute into the future of the Simscope server machine clock.

For example, if a compute node's machine clock is 10 minutes ahead of Simscope machine clock, this could possibly introduce negative runtime bugs, due to timestamp skew.

Now, if a live job is published beyond 1 minute into the future, Simscope will reject the live job.

Normal job finishes (pass or fail jobs) in the future are still allowed, but they will automatically be clamped to Simscope machine clock (so they are not future).

2. `feature` Increased Metrics DB to 20 fields

Increased the Metrics DB to a 20-field limit.

1.510

1. `bugfix` Fixed bugs in Live job timeout

SIMSCOPE-125

The livetimeoutsignature feature did not work previously in cases where regression submitted was not set.

Now it should always check for stranded/lost live jobs at the regr-finish event.

alpha,bravo,charlie

Simscope Administration Guide