| V1 |
|
100.00% |
| V2 |
|
97.65% |
| V2S |
|
96.35% |
| V3 |
|
0.00% |
| Testpoint | Test | Max Runtime | Sim Time | Pass | Total | % |
|---|---|---|---|---|---|---|
| smoke | 2 | 2 | 100.00 | |||
| otbn_smoke | 16.000s | 42.595us | 1 | 1 | 100.00 | |
| otbn_smoke_vectorized | 11.000s | 38.166us | 1 | 1 | 100.00 | |
| single_binary | 100 | 100 | 100.00 | |||
| otbn_single | 325.000s | 796.166us | 100 | 100 | 100.00 | |
| csr_hw_reset | 1 | 1 | 100.00 | |||
| otbn_csr_hw_reset | 7.000s | 27.282us | 1 | 1 | 100.00 | |
| csr_rw | 5 | 5 | 100.00 | |||
| otbn_csr_rw | 9.000s | 29.312us | 5 | 5 | 100.00 | |
| csr_bit_bash | 1 | 1 | 100.00 | |||
| otbn_csr_bit_bash | 18.000s | 520.442us | 1 | 1 | 100.00 | |
| csr_aliasing | 1 | 1 | 100.00 | |||
| otbn_csr_aliasing | 6.000s | 44.333us | 1 | 1 | 100.00 | |
| csr_mem_rw_with_rand_reset | 5 | 5 | 100.00 | |||
| otbn_csr_mem_rw_with_rand_reset | 11.000s | 135.579us | 5 | 5 | 100.00 | |
| regwen_csr_and_corresponding_lockable_csr | 6 | 6 | 100.00 | |||
| otbn_csr_rw | 9.000s | 29.312us | 5 | 5 | 100.00 | |
| otbn_csr_aliasing | 6.000s | 44.333us | 1 | 1 | 100.00 | |
| mem_walk | 1 | 1 | 100.00 | |||
| otbn_mem_walk | 112.000s | 3356.664us | 1 | 1 | 100.00 | |
| mem_partial_access | 1 | 1 | 100.00 | |||
| otbn_mem_partial_access | 48.000s | 738.115us | 1 | 1 | 100.00 | |
| Testpoint | Test | Max Runtime | Sim Time | Pass | Total | % |
|---|---|---|---|---|---|---|
| reset_recovery | 10 | 10 | 100.00 | |||
| otbn_reset | 73.000s | 470.442us | 10 | 10 | 100.00 | |
| multi_error | 1 | 1 | 100.00 | |||
| otbn_multi_err | 85.000s | 205.214us | 1 | 1 | 100.00 | |
| wfi | 7 | 7 | 100.00 | |||
| otbn_wfi_smoke | 8.000s | 44.601us | 1 | 1 | 100.00 | |
| otbn_wfi_sec_wipe | 11.000s | 21.296us | 5 | 5 | 100.00 | |
| otbn_wfi_back_to_back | 8.000s | 125.138us | 1 | 1 | 100.00 | |
| back_to_back | 10 | 10 | 100.00 | |||
| otbn_multi | 107.000s | 726.383us | 10 | 10 | 100.00 | |
| stress_all | 10 | 10 | 100.00 | |||
| otbn_stress_all | 155.000s | 320.518us | 10 | 10 | 100.00 | |
| lc_escalation | 56 | 60 | 93.33 | |||
| otbn_escalate | 138.000s | 346.638us | 56 | 60 | 93.33 | |
| zero_state_err_urnd | 5 | 5 | 100.00 | |||
| otbn_zero_state_err_urnd | 9.000s | 70.465us | 5 | 5 | 100.00 | |
| sw_errs_fatal_chk | 10 | 10 | 100.00 | |||
| otbn_sw_errs_fatal_chk | 34.000s | 72.126us | 10 | 10 | 100.00 | |
| alert_test | 10 | 10 | 100.00 | |||
| otbn_alert_test | 18.000s | 48.374us | 10 | 10 | 100.00 | |
| intr_test | 10 | 10 | 100.00 | |||
| otbn_intr_test | 7.000s | 15.985us | 10 | 10 | 100.00 | |
| tl_d_oob_addr_access | 25 | 25 | 100.00 | |||
| otbn_tl_errors | 14.000s | 1155.284us | 25 | 25 | 100.00 | |
| tl_d_illegal_access | 25 | 25 | 100.00 | |||
| otbn_tl_errors | 14.000s | 1155.284us | 25 | 25 | 100.00 | |
| tl_d_outstanding_access | 12 | 12 | 100.00 | |||
| otbn_csr_hw_reset | 7.000s | 27.282us | 1 | 1 | 100.00 | |
| otbn_csr_rw | 9.000s | 29.312us | 5 | 5 | 100.00 | |
| otbn_csr_aliasing | 6.000s | 44.333us | 1 | 1 | 100.00 | |
| otbn_same_csr_outstanding | 7.000s | 54.149us | 5 | 5 | 100.00 | |
| tl_d_partial_access | 12 | 12 | 100.00 | |||
| otbn_csr_hw_reset | 7.000s | 27.282us | 1 | 1 | 100.00 | |
| otbn_csr_rw | 9.000s | 29.312us | 5 | 5 | 100.00 | |
| otbn_csr_aliasing | 6.000s | 44.333us | 1 | 1 | 100.00 | |
| otbn_same_csr_outstanding | 7.000s | 54.149us | 5 | 5 | 100.00 | |
| Testpoint | Test | Max Runtime | Sim Time | Pass | Total | % |
|---|---|---|---|---|---|---|
| mem_integrity | 25 | 25 | 100.00 | |||
| otbn_imem_err | 17.000s | 62.984us | 10 | 10 | 100.00 | |
| otbn_dmem_err | 214.000s | 569.498us | 15 | 15 | 100.00 | |
| internal_integrity | 15 | 17 | 88.24 | |||
| otbn_alu_bignum_mod_err | 27.000s | 75.552us | 4 | 5 | 80.00 | |
| otbn_controller_ispr_rdata_err | 17.000s | 241.822us | 5 | 5 | 100.00 | |
| otbn_mac_bignum_acc_err | 16.000s | 56.042us | 5 | 5 | 100.00 | |
| otbn_urnd_err | 8.000s | 10.290us | 1 | 2 | 50.00 | |
| illegal_bus_access | 5 | 5 | 100.00 | |||
| otbn_illegal_mem_acc | 15.000s | 36.369us | 5 | 5 | 100.00 | |
| otbn_mem_gnt_acc_err | 2 | 2 | 100.00 | |||
| otbn_mem_gnt_acc_err | 10.000s | 13.979us | 2 | 2 | 100.00 | |
| otbn_non_sec_partial_wipe | 9 | 10 | 90.00 | |||
| otbn_partial_wipe | 13.000s | 27.020us | 9 | 10 | 90.00 | |
| tl_intg_err | 29 | 30 | 96.67 | |||
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| otbn_tl_intg_err | 129.000s | 566.419us | 25 | 25 | 100.00 | |
| passthru_mem_tl_intg_err | 5 | 5 | 100.00 | |||
| otbn_passthru_mem_tl_intg_err | 69.000s | 341.321us | 5 | 5 | 100.00 | |
| prim_fsm_check | 4 | 5 | 80.00 | |||
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| prim_count_check | 4 | 5 | 80.00 | |||
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| sec_cm_mem_scramble | 1 | 1 | 100.00 | |||
| otbn_smoke | 16.000s | 42.595us | 1 | 1 | 100.00 | |
| sec_cm_data_mem_integrity | 15 | 15 | 100.00 | |||
| otbn_dmem_err | 214.000s | 569.498us | 15 | 15 | 100.00 | |
| sec_cm_instruction_mem_integrity | 10 | 10 | 100.00 | |||
| otbn_imem_err | 17.000s | 62.984us | 10 | 10 | 100.00 | |
| sec_cm_bus_integrity | 25 | 25 | 100.00 | |||
| otbn_tl_intg_err | 129.000s | 566.419us | 25 | 25 | 100.00 | |
| sec_cm_controller_fsm_global_esc | 56 | 60 | 93.33 | |||
| otbn_escalate | 138.000s | 346.638us | 56 | 60 | 93.33 | |
| sec_cm_controller_fsm_local_esc | 39 | 40 | 97.50 | |||
| otbn_imem_err | 17.000s | 62.984us | 10 | 10 | 100.00 | |
| otbn_dmem_err | 214.000s | 569.498us | 15 | 15 | 100.00 | |
| otbn_zero_state_err_urnd | 9.000s | 70.465us | 5 | 5 | 100.00 | |
| otbn_illegal_mem_acc | 15.000s | 36.369us | 5 | 5 | 100.00 | |
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| sec_cm_controller_fsm_sparse | 4 | 5 | 80.00 | |||
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| sec_cm_scramble_key_sideload | 100 | 100 | 100.00 | |||
| otbn_single | 325.000s | 796.166us | 100 | 100 | 100.00 | |
| sec_cm_scramble_ctrl_fsm_local_esc | 39 | 40 | 97.50 | |||
| otbn_imem_err | 17.000s | 62.984us | 10 | 10 | 100.00 | |
| otbn_dmem_err | 214.000s | 569.498us | 15 | 15 | 100.00 | |
| otbn_zero_state_err_urnd | 9.000s | 70.465us | 5 | 5 | 100.00 | |
| otbn_illegal_mem_acc | 15.000s | 36.369us | 5 | 5 | 100.00 | |
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| sec_cm_scramble_ctrl_fsm_sparse | 4 | 5 | 80.00 | |||
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| sec_cm_start_stop_ctrl_fsm_global_esc | 56 | 60 | 93.33 | |||
| otbn_escalate | 138.000s | 346.638us | 56 | 60 | 93.33 | |
| sec_cm_start_stop_ctrl_fsm_local_esc | 39 | 40 | 97.50 | |||
| otbn_imem_err | 17.000s | 62.984us | 10 | 10 | 100.00 | |
| otbn_dmem_err | 214.000s | 569.498us | 15 | 15 | 100.00 | |
| otbn_zero_state_err_urnd | 9.000s | 70.465us | 5 | 5 | 100.00 | |
| otbn_illegal_mem_acc | 15.000s | 36.369us | 5 | 5 | 100.00 | |
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| sec_cm_start_stop_ctrl_fsm_sparse | 4 | 5 | 80.00 | |||
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| sec_cm_data_reg_sw_sca | 100 | 100 | 100.00 | |||
| otbn_single | 325.000s | 796.166us | 100 | 100 | 100.00 | |
| sec_cm_ctrl_redun | 12 | 12 | 100.00 | |||
| otbn_ctrl_redun | 14.000s | 35.897us | 12 | 12 | 100.00 | |
| sec_cm_pc_ctrl_flow_redun | 5 | 5 | 100.00 | |||
| otbn_pc_ctrl_flow_redun | 13.000s | 22.661us | 5 | 5 | 100.00 | |
| sec_cm_rnd_bus_consistency | 5 | 5 | 100.00 | |||
| otbn_rnd_sec_cm | 60.000s | 381.090us | 5 | 5 | 100.00 | |
| sec_cm_rnd_rng_digest | 5 | 5 | 100.00 | |||
| otbn_rnd_sec_cm | 60.000s | 381.090us | 5 | 5 | 100.00 | |
| sec_cm_rf_base_data_reg_sw_integrity | 10 | 10 | 100.00 | |||
| otbn_rf_base_intg_err | 20.000s | 62.615us | 10 | 10 | 100.00 | |
| sec_cm_rf_base_data_reg_sw_glitch_detect | 4 | 5 | 80.00 | |||
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| sec_cm_stack_wr_ptr_ctr_redun | 4 | 5 | 80.00 | |||
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| sec_cm_rf_bignum_data_reg_sw_integrity | 7 | 10 | 70.00 | |||
| otbn_rf_bignum_intg_err | 24.000s | 104.498us | 7 | 10 | 70.00 | |
| sec_cm_rf_bignum_data_reg_sw_glitch_detect | 4 | 5 | 80.00 | |||
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| sec_cm_loop_stack_ctr_redun | 4 | 5 | 80.00 | |||
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| sec_cm_loop_stack_addr_integrity | 5 | 5 | 100.00 | |||
| otbn_stack_addr_integ_chk | 29.000s | 47.727us | 5 | 5 | 100.00 | |
| sec_cm_call_stack_addr_integrity | 5 | 5 | 100.00 | |||
| otbn_stack_addr_integ_chk | 29.000s | 47.727us | 5 | 5 | 100.00 | |
| sec_cm_start_stop_ctrl_state_consistency | 6 | 7 | 85.71 | |||
| otbn_sec_wipe_err | 19.000s | 414.923us | 6 | 7 | 85.71 | |
| sec_cm_data_mem_sec_wipe | 100 | 100 | 100.00 | |||
| otbn_single | 325.000s | 796.166us | 100 | 100 | 100.00 | |
| sec_cm_instruction_mem_sec_wipe | 100 | 100 | 100.00 | |||
| otbn_single | 325.000s | 796.166us | 100 | 100 | 100.00 | |
| sec_cm_data_reg_sw_sec_wipe | 100 | 100 | 100.00 | |||
| otbn_single | 325.000s | 796.166us | 100 | 100 | 100.00 | |
| sec_cm_write_mem_integrity | 10 | 10 | 100.00 | |||
| otbn_multi | 107.000s | 726.383us | 10 | 10 | 100.00 | |
| sec_cm_ctrl_flow_count | 100 | 100 | 100.00 | |||
| otbn_single | 325.000s | 796.166us | 100 | 100 | 100.00 | |
| sec_cm_ctrl_flow_sca | 100 | 100 | 100.00 | |||
| otbn_single | 325.000s | 796.166us | 100 | 100 | 100.00 | |
| sec_cm_data_mem_sw_noaccess | 5 | 5 | 100.00 | |||
| otbn_sw_no_acc | 29.000s | 197.925us | 5 | 5 | 100.00 | |
| sec_cm_key_sideload | 100 | 100 | 100.00 | |||
| otbn_single | 325.000s | 796.166us | 100 | 100 | 100.00 | |
| sec_cm_tlul_fifo_ctr_redun | 4 | 5 | 80.00 | |||
| otbn_sec_cm | 598.000s | 14777.788us | 4 | 5 | 80.00 | |
| Testpoint | Test | Max Runtime | Sim Time | Pass | Total | % |
|---|---|---|---|---|---|---|
| stress_all_with_rand_reset | 0 | 10 | 0.00 | |||
| otbn_stress_all_with_rand_reset | 38.000s | 62.733us | 0 | 10 | 0.00 | |
| Test | seed | line | log context | |
|---|---|---|---|---|
| UVM_FATAL sequencer [SEQDEFPRI] Sequence parent_sequence has illegal priority: -* | 9 test runs | |||
| otbn_stress_all_with_rand_reset | 71204104705071439309982968734281748312569842502043460234439528996485888018665 | 149 |
UVM_INFO @ 31307251 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 100575201385114967457408863396384462237132475214599037796757200380834417979090 | 148 |
UVM_INFO @ 16384435 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 54623330575485552606491421913501032701763409003204885009111546823980043253092 | 147 |
UVM_INFO @ 35603627 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 48334712839724475486140123490746524793880271167304205842761968222746535731913 | 146 |
UVM_INFO @ 58249724 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 59937266329259619229769858551802882050006843943074909030644682323632521538079 | 145 |
UVM_INFO @ 26263780 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 54010599945113049355157019769491404150830185731374499757770905796750977982430 | 161 |
UVM_INFO @ 62732909 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 10179872778828911224965901286339627963650722498095000156419677305139059230319 | 146 |
UVM_INFO @ 56745901 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 38292135710555967665599270619743337608342342384978619420641385968883670144084 | 154 |
UVM_INFO @ 19549050 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 67770766201520002664023682625141756898656346809713263428603967933706251626652 | 159 |
UVM_INFO @ 9333842 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| UVM_ERROR (cip_base_scoreboard.sv:256) scoreboard [scoreboard] alert fatal has unexpected timeout error | 6 test runs | |||
| otbn_sec_cm | 93176098767193020101076386298586810848753126904669281787587207673475790204166 | 172 |
UVM_INFO @ 742466040 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_rf_bignum_intg_err | 74872682287532729469221120386874460486827349795479976705845497649611806785740 | 114 |
UVM_INFO @ 33354698 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_alu_bignum_mod_err | 88064996160013551214043216771422556729902969221876823946374991977121537963780 | 113 |
UVM_INFO @ 51905885 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_rf_bignum_intg_err | 64962812125953339065409684636692709758174609583546291972469492499537957187752 | 111 |
UVM_INFO @ 819525494 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_rf_bignum_intg_err | 10740250676021083050943669616084787659767841745071108115545463020082021039956 | 109 |
UVM_INFO @ 135880238 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_escalate | 112295520832957013874649813625528855141097634452719886239265109711951192229590 | 118 |
UVM_INFO @ 41280449 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| UVM_ERROR (otbn_scoreboard.sv:327) [scoreboard] Check failed item.d_data == exp_read_data.val (* [*] vs * [*]) value for register otbn_reg_block.status | 2 test runs | |||
| otbn_escalate | 47422851166059618368983380577655191337956231472542596181326394328678650039856 | 105 |
UVM_INFO @ 5039445 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_escalate | 113212125430504790702717833511080114123809364485695409549518211683667434524415 | 107 |
UVM_INFO @ 5135067 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| xmsim: *E,ASRTST (/nightly/current_run/scratch/master/otbn-sim-xcelium/default/fusesoc-work/src/lowrisc_dv_otbn_sva_*/otbn_idle_checker.sv,196): Assertion NotRunningWhenLocked_A has failed | 1 test run | |||
| otbn_urnd_err | 60763257722719283670733325827070661795246344797634149284641201949129118364607 | 113 |
UVM_ERROR @ 5322104 ps: (otbn_idle_checker.sv:196) [ASSERT FAILED] NotRunningWhenLocked_A
UVM_INFO @ 5322104 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| UVM_ERROR (cip_base_vseq.sv:1099) virtual_sequencer [otbn_sec_wipe_err_vseq] Expected alert (fatal) did not fire in * cycles. | 1 test run | |||
| otbn_sec_wipe_err | 43660641888699531595828544242977704557911227698940803724133887163271524054622 | 113 |
UVM_INFO @ 72166042 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| xmsim: *E,ASRTST (/nightly/current_run/scratch/master/otbn-sim-xcelium/default/fusesoc-work/src/lowrisc_dv_otbn_sva_*/otbn_idle_checker.sv,186): Assertion IdleIfLockedAndNotRotatingKeys_A has failed (* cycles, starting * PS) | 1 test run | |||
| otbn_partial_wipe | 77461979523120834512585278105609048793342750509066787234821418072660106074637 | 116 |
UVM_ERROR @ 27019677 ps: (otbn_idle_checker.sv:186) [ASSERT FAILED] IdleIfLockedAndNotRotatingKeys_A
UVM_INFO @ 27019677 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| UVM_FATAL (otbn_base_vseq.sv:352) [otbn_dmem_err_vseq] Check failed (!cfg.under_reset) | 1 test run | |||
| otbn_stress_all_with_rand_reset | 81373372658778478084302945257690107578839123010146714804217795631329872214373 | 144 |
UVM_INFO @ 39130266 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| xmsim: *E,ASRTST (/nightly/current_run/scratch/master/otbn-sim-xcelium/default/fusesoc-work/src/lowrisc_dv_otbn_env_*/otbn_insn_cnt_if.sv,21): Assertion InsnCntMatches_A has failed | 1 test run | |||
| otbn_escalate | 61795075328702467801214347762819018996052187761445786435494538163806278039745 | 117 |
UVM_ERROR @ 57294358 ps: (otbn_insn_cnt_if.sv:21) [ASSERT FAILED] InsnCntMatches_A
UVM_INFO @ 57294358 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|