Simscope Release History

How to upgrade?

Note: to upgrade your Simscope or Tunnel version, please follow the Upgrade instructions.

1.519

1. `feature` Added Global Age column in Signature table

The Signature table now shows a new column Global Age, in addition to the Window First Seen column.

This also allows sorting by Age, to show the oldest or newest Signature.

2. `feature` Added Timezone into Daily/Weekly charts

For Daily and Weekly charts, Simscope now prints the server timezone, to clarify to the users that the chart may be rendered in a timezone different than their local browser client timezone.

3. `feature` Replaced simscope-test-args with simscope-option-summary

The simscope-test-args Regression Plugin has been renamed to simcope-option-summary and has a batch of display improvements:

4. `bugfix` Fixed SMTP hang bug during shutdown

If network is interrupted, in previous releases, shutdown could hang waiting on SMTP.

This bug is now fixed.

5. `bugfix` Fixed Dark mode bug found in ADO

In previous releases, Simscope embedded as iframe into ADO was showing black horizonal bars, for users with Dark mode profile enabled.

Note: Simscope does not support true dark mode currently.

1.518

`feature` Job Histogram: Colorized Pass vs Fail series (green/red)

The Job Histogram now renders histogram value bars in green/red colors, to indicate pass vs fail.

Example:

`feature` Runtag separator splitting and drilldown

Regression Tags can now be separated by a string delimiter, to allow a list of runtags.

For example, if the separator is space, then the tag "cov daily" indicates two tags: run and daily.

Each tag is clickable from Simscope to allow drilldown.

`feature` Auto-refreshing Live regressions

Live regressions now auto-refresh within the web browser, as progress is made.

This allows users to monitor regression results, without clicking refresh.

`feature` Gsheets Testplan Template 0.1

New script simscope-gsheets-testplan.py to allow a Google Gsheets testplan template, score the result based on a Simscope regression, and store back into Simscope coverage DB.

This flow is currently alpha status, and under improvement.

`bugfix` Fixed a sub-model coverage bug

SIMSCOPE-135

Fixed a bug with ambiguous sub-model coverage.

`bugfix` Regression Series Latest: foo/$

Fixed a few pages to support Regression Latest Links via $.

This allows a fixed URL to auto-refresh from the latest regression matching a pattern.

`bugfix` JS fixed pie chart hover bug

Fixed a pie chart hover bug.

`bugfix` Job histogram bug: skips

In previous releases, the Job Histogram charts omitted skip results. These now are included.

1.517

`feature` New chart selection: Regression Metric Value (sum)

This release adds a new chart selection:

Regression Metric Value (sum)

This allows rendering summed (ie total) metric values across regressions.

As opposed to Regression Metric Value (average), which renders averaged values.

For example, if rendering a chart of the metric license_seats, you can render:

Total licenses used for a day
As opposed to Average licenses used per day

1.516

1. `feature` New Regression Series Drilldown/Grouping

This release includes an easier navigation and drilldown within Regression Search, to enable dynamic grouping of results by:

Component
Regression Name
Run Group
Branch
Model Version
or just a table list view

Example drilldown by run group, with totals:

2. `feature` Improved test list search pass/fail

Test list search table now shows jobs in green or red color, to indicate pass/fail status.

3. `feature` Regression DB archive/compress

Administrators can now Archive Regressions, which compresses DB disk usage by approximately 50%.

This process strips out job metadata fields from all pass jobs.
Fail jobs are not affected.

To execute, click the Archive (Compress) link.

Be patient, as this can be slow if many regressions are selected.

Also, be careful, as this removes data from your DB.

1.515

1. `feature` Added livetimeoutjoblimit option

Added livetimeoutjoblimit config variable to simscope.config, if you want to time out more than 500 Live Jobs per regression.

2. `feature` Added pagination to Live

Live job search results are now paginated.

3. `feature` Added primaryscorecategory option

Added primaryscorecategory config option to simscope.config, to show only a single Job Category in the Score (pass rate) for regression details.

For example, setting this to sim will show only simulation score at the top, rather than combined regression score including build, generation, etc.

4. `bugfix` Fixed scatter plot bug with +

SIMSCOPE-130

Scatter plots with regex-based regression searches are now working.

5. `feature` Improved display of Lost/Missing jobs

SIMSCOPE-131

Simscope now shows a Lost jobs column if there are lost/missing live jobs in a regression.

1.514

1. `feature` Improved metric charts in large browsers

Metric charts now automatically scale horizontally and vertically, to fit into large client web browser windows.

Previously charts had a fixed maximum size, so they may look small on large monitors.

2. `feature` Copy SHA to Clipboard

Users can now click on SHA (model versions) in Simscope to copy to full value of Model Version into the user's clipboard (for easy copy/paste).

For example, if a user clicks an abbreviated SHA abcdef in Simscope, it will copy abcdef1234567890 into their clipboard.

3. `bugfix` Live job timeout limit increased

SIMSCOPE-128

If a regression finishes with outstanding Live Jobs, Simscope will now convert up to 500 jobs into timeout errors.

Any remaining jobs will be left as live.

Previously it would only convert the first 100.

SIMSCOPE-129

In previous releases, if Simscope is embedded into iframe containers, it would print an incorrect warning about cookies into the browser window.

This bug is fixed.

5. `feature` Run Groups

Simscope can now show a List of Run Groups, which can be clicked to drilldown to view a list of regressions within that group.

This example shows a list of Weekly run groups:

6. `feature` Improved model-version charts

Rendering line charts with Time Period set to Model Version now render as scatter charts.

1.513

1. `bugfix` Fixed scatter plot limit bug

In previous releases, scatter plots were limited to 1000 data points. This has been increased to 5000, and if beyond that this will print an error message.

2. `bugfix` Added regression plugin output limit

Regression plugins are now limited to 10k lines of stdout output when executing, to prevent client browsers from hanging.

1.512

1. `bugfix` Fixed isoweek bug in Signatures

There was a bug in previous releases when using "This Work Week" or "Last Work Week" in the Signature search page.

2. `bugfix` Fixed ambiguity bug in sub-model-coverage

SIMSCOPE-126

Fixed a bug related to ambiguous regression and coverage model names.

For example, alpha.first.smoke/beta/12.fpu now resolves to:

Field	Value
Regression series	`alpha.first.smoke/beta`
Regression ID	`12`
Coverage model	`fpu`

1.511

1. `bugfix` Fixed a negative Live Job runtime bug

SIMSCOPE-125

When publishing Live jobs, Simscope now checks that the job JSON start timestamp is no more than one minute into the future of the Simscope server machine clock.

For example, if a compute node's machine clock is 10 minutes ahead of Simscope machine clock, this could possibly introduce negative runtime bugs, due to timestamp skew.

Now, if a live job is published beyond 1 minute into the future, Simscope will reject the live job.

Normal job finishes (pass or fail jobs) in the future are still allowed, but they will automatically be clamped to Simscope machine clock (so they are not future).

2. `feature` Increased Metrics DB to 20 fields

Increased the Metrics DB to a 20-field limit.

1.510

1. `bugfix` Fixed bugs in Live job timeout

SIMSCOPE-125

The livetimeoutsignature feature did not work previously in cases where regression submitted was not set.

Now it should always check for stranded/lost live jobs at the regr-finish event.

alpha,bravo,charlie

Simscope Administration Guide