| V1 |
|
100.00% |
| V2 |
|
95.88% |
| V2S |
|
96.96% |
| V3 |
|
0.00% |
| Testpoint | Test | Max Runtime | Sim Time | Pass | Total | % |
|---|---|---|---|---|---|---|
| smoke | 2 | 2 | 100.00 | |||
| otbn_smoke | 22.000s | 122.539us | 1 | 1 | 100.00 | |
| otbn_smoke_vectorized | 11.000s | 74.220us | 1 | 1 | 100.00 | |
| single_binary | 100 | 100 | 100.00 | |||
| otbn_single | 177.000s | 487.413us | 100 | 100 | 100.00 | |
| csr_hw_reset | 1 | 1 | 100.00 | |||
| otbn_csr_hw_reset | 6.000s | 45.854us | 1 | 1 | 100.00 | |
| csr_rw | 5 | 5 | 100.00 | |||
| otbn_csr_rw | 6.000s | 55.711us | 5 | 5 | 100.00 | |
| csr_bit_bash | 1 | 1 | 100.00 | |||
| otbn_csr_bit_bash | 8.000s | 138.565us | 1 | 1 | 100.00 | |
| csr_aliasing | 1 | 1 | 100.00 | |||
| otbn_csr_aliasing | 6.000s | 11.673us | 1 | 1 | 100.00 | |
| csr_mem_rw_with_rand_reset | 5 | 5 | 100.00 | |||
| otbn_csr_mem_rw_with_rand_reset | 10.000s | 142.394us | 5 | 5 | 100.00 | |
| regwen_csr_and_corresponding_lockable_csr | 6 | 6 | 100.00 | |||
| otbn_csr_rw | 6.000s | 55.711us | 5 | 5 | 100.00 | |
| otbn_csr_aliasing | 6.000s | 11.673us | 1 | 1 | 100.00 | |
| mem_walk | 1 | 1 | 100.00 | |||
| otbn_mem_walk | 155.000s | 6183.400us | 1 | 1 | 100.00 | |
| mem_partial_access | 1 | 1 | 100.00 | |||
| otbn_mem_partial_access | 84.000s | 4190.325us | 1 | 1 | 100.00 | |
| Testpoint | Test | Max Runtime | Sim Time | Pass | Total | % |
|---|---|---|---|---|---|---|
| reset_recovery | 9 | 10 | 90.00 | |||
| otbn_reset | 96.000s | 461.054us | 9 | 10 | 90.00 | |
| multi_error | 0 | 1 | 0.00 | |||
| otbn_multi_err | 65.000s | 135.016us | 0 | 1 | 0.00 | |
| wfi | 7 | 7 | 100.00 | |||
| otbn_wfi_smoke | 8.000s | 65.690us | 1 | 1 | 100.00 | |
| otbn_wfi_sec_wipe | 13.000s | 25.607us | 5 | 5 | 100.00 | |
| otbn_wfi_back_to_back | 9.000s | 21.291us | 1 | 1 | 100.00 | |
| back_to_back | 9 | 10 | 90.00 | |||
| otbn_multi | 231.000s | 571.665us | 9 | 10 | 90.00 | |
| stress_all | 10 | 10 | 100.00 | |||
| otbn_stress_all | 116.000s | 606.793us | 10 | 10 | 100.00 | |
| lc_escalation | 57 | 60 | 95.00 | |||
| otbn_escalate | 160.000s | 412.304us | 57 | 60 | 95.00 | |
| zero_state_err_urnd | 4 | 5 | 80.00 | |||
| otbn_zero_state_err_urnd | 13.000s | 22.257us | 4 | 5 | 80.00 | |
| sw_errs_fatal_chk | 10 | 10 | 100.00 | |||
| otbn_sw_errs_fatal_chk | 568.000s | 1350.645us | 10 | 10 | 100.00 | |
| alert_test | 10 | 10 | 100.00 | |||
| otbn_alert_test | 11.000s | 17.977us | 10 | 10 | 100.00 | |
| intr_test | 10 | 10 | 100.00 | |||
| otbn_intr_test | 12.000s | 30.069us | 10 | 10 | 100.00 | |
| tl_d_oob_addr_access | 25 | 25 | 100.00 | |||
| otbn_tl_errors | 13.000s | 169.593us | 25 | 25 | 100.00 | |
| tl_d_illegal_access | 25 | 25 | 100.00 | |||
| otbn_tl_errors | 13.000s | 169.593us | 25 | 25 | 100.00 | |
| tl_d_outstanding_access | 12 | 12 | 100.00 | |||
| otbn_csr_hw_reset | 6.000s | 45.854us | 1 | 1 | 100.00 | |
| otbn_csr_rw | 6.000s | 55.711us | 5 | 5 | 100.00 | |
| otbn_csr_aliasing | 6.000s | 11.673us | 1 | 1 | 100.00 | |
| otbn_same_csr_outstanding | 8.000s | 25.799us | 5 | 5 | 100.00 | |
| tl_d_partial_access | 12 | 12 | 100.00 | |||
| otbn_csr_hw_reset | 6.000s | 45.854us | 1 | 1 | 100.00 | |
| otbn_csr_rw | 6.000s | 55.711us | 5 | 5 | 100.00 | |
| otbn_csr_aliasing | 6.000s | 11.673us | 1 | 1 | 100.00 | |
| otbn_same_csr_outstanding | 8.000s | 25.799us | 5 | 5 | 100.00 | |
| Testpoint | Test | Max Runtime | Sim Time | Pass | Total | % |
|---|---|---|---|---|---|---|
| mem_integrity | 25 | 25 | 100.00 | |||
| otbn_imem_err | 18.000s | 35.405us | 10 | 10 | 100.00 | |
| otbn_dmem_err | 25.000s | 67.214us | 15 | 15 | 100.00 | |
| internal_integrity | 14 | 17 | 82.35 | |||
| otbn_alu_bignum_mod_err | 18.000s | 331.134us | 4 | 5 | 80.00 | |
| otbn_controller_ispr_rdata_err | 18.000s | 271.883us | 4 | 5 | 80.00 | |
| otbn_mac_bignum_acc_err | 29.000s | 112.226us | 5 | 5 | 100.00 | |
| otbn_urnd_err | 8.000s | 26.290us | 1 | 2 | 50.00 | |
| illegal_bus_access | 5 | 5 | 100.00 | |||
| otbn_illegal_mem_acc | 13.000s | 34.138us | 5 | 5 | 100.00 | |
| otbn_mem_gnt_acc_err | 2 | 2 | 100.00 | |||
| otbn_mem_gnt_acc_err | 13.000s | 22.841us | 2 | 2 | 100.00 | |
| otbn_non_sec_partial_wipe | 10 | 10 | 100.00 | |||
| otbn_partial_wipe | 12.000s | 30.611us | 10 | 10 | 100.00 | |
| tl_intg_err | 30 | 30 | 100.00 | |||
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| otbn_tl_intg_err | 90.000s | 387.347us | 25 | 25 | 100.00 | |
| passthru_mem_tl_intg_err | 5 | 5 | 100.00 | |||
| otbn_passthru_mem_tl_intg_err | 69.000s | 182.909us | 5 | 5 | 100.00 | |
| prim_fsm_check | 5 | 5 | 100.00 | |||
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| prim_count_check | 5 | 5 | 100.00 | |||
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| sec_cm_mem_scramble | 1 | 1 | 100.00 | |||
| otbn_smoke | 22.000s | 122.539us | 1 | 1 | 100.00 | |
| sec_cm_data_mem_integrity | 15 | 15 | 100.00 | |||
| otbn_dmem_err | 25.000s | 67.214us | 15 | 15 | 100.00 | |
| sec_cm_instruction_mem_integrity | 10 | 10 | 100.00 | |||
| otbn_imem_err | 18.000s | 35.405us | 10 | 10 | 100.00 | |
| sec_cm_bus_integrity | 25 | 25 | 100.00 | |||
| otbn_tl_intg_err | 90.000s | 387.347us | 25 | 25 | 100.00 | |
| sec_cm_controller_fsm_global_esc | 57 | 60 | 95.00 | |||
| otbn_escalate | 160.000s | 412.304us | 57 | 60 | 95.00 | |
| sec_cm_controller_fsm_local_esc | 39 | 40 | 97.50 | |||
| otbn_imem_err | 18.000s | 35.405us | 10 | 10 | 100.00 | |
| otbn_dmem_err | 25.000s | 67.214us | 15 | 15 | 100.00 | |
| otbn_zero_state_err_urnd | 13.000s | 22.257us | 4 | 5 | 80.00 | |
| otbn_illegal_mem_acc | 13.000s | 34.138us | 5 | 5 | 100.00 | |
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| sec_cm_controller_fsm_sparse | 5 | 5 | 100.00 | |||
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| sec_cm_scramble_key_sideload | 100 | 100 | 100.00 | |||
| otbn_single | 177.000s | 487.413us | 100 | 100 | 100.00 | |
| sec_cm_scramble_ctrl_fsm_local_esc | 39 | 40 | 97.50 | |||
| otbn_imem_err | 18.000s | 35.405us | 10 | 10 | 100.00 | |
| otbn_dmem_err | 25.000s | 67.214us | 15 | 15 | 100.00 | |
| otbn_zero_state_err_urnd | 13.000s | 22.257us | 4 | 5 | 80.00 | |
| otbn_illegal_mem_acc | 13.000s | 34.138us | 5 | 5 | 100.00 | |
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| sec_cm_scramble_ctrl_fsm_sparse | 5 | 5 | 100.00 | |||
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| sec_cm_start_stop_ctrl_fsm_global_esc | 57 | 60 | 95.00 | |||
| otbn_escalate | 160.000s | 412.304us | 57 | 60 | 95.00 | |
| sec_cm_start_stop_ctrl_fsm_local_esc | 39 | 40 | 97.50 | |||
| otbn_imem_err | 18.000s | 35.405us | 10 | 10 | 100.00 | |
| otbn_dmem_err | 25.000s | 67.214us | 15 | 15 | 100.00 | |
| otbn_zero_state_err_urnd | 13.000s | 22.257us | 4 | 5 | 80.00 | |
| otbn_illegal_mem_acc | 13.000s | 34.138us | 5 | 5 | 100.00 | |
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| sec_cm_start_stop_ctrl_fsm_sparse | 5 | 5 | 100.00 | |||
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| sec_cm_data_reg_sw_sca | 100 | 100 | 100.00 | |||
| otbn_single | 177.000s | 487.413us | 100 | 100 | 100.00 | |
| sec_cm_ctrl_redun | 12 | 12 | 100.00 | |||
| otbn_ctrl_redun | 22.000s | 55.573us | 12 | 12 | 100.00 | |
| sec_cm_pc_ctrl_flow_redun | 5 | 5 | 100.00 | |||
| otbn_pc_ctrl_flow_redun | 10.000s | 55.532us | 5 | 5 | 100.00 | |
| sec_cm_rnd_bus_consistency | 5 | 5 | 100.00 | |||
| otbn_rnd_sec_cm | 118.000s | 215.104us | 5 | 5 | 100.00 | |
| sec_cm_rnd_rng_digest | 5 | 5 | 100.00 | |||
| otbn_rnd_sec_cm | 118.000s | 215.104us | 5 | 5 | 100.00 | |
| sec_cm_rf_base_data_reg_sw_integrity | 10 | 10 | 100.00 | |||
| otbn_rf_base_intg_err | 18.000s | 33.727us | 10 | 10 | 100.00 | |
| sec_cm_rf_base_data_reg_sw_glitch_detect | 5 | 5 | 100.00 | |||
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| sec_cm_stack_wr_ptr_ctr_redun | 5 | 5 | 100.00 | |||
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| sec_cm_rf_bignum_data_reg_sw_integrity | 8 | 10 | 80.00 | |||
| otbn_rf_bignum_intg_err | 21.000s | 178.916us | 8 | 10 | 80.00 | |
| sec_cm_rf_bignum_data_reg_sw_glitch_detect | 5 | 5 | 100.00 | |||
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| sec_cm_loop_stack_ctr_redun | 5 | 5 | 100.00 | |||
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| sec_cm_loop_stack_addr_integrity | 5 | 5 | 100.00 | |||
| otbn_stack_addr_integ_chk | 32.000s | 61.431us | 5 | 5 | 100.00 | |
| sec_cm_call_stack_addr_integrity | 5 | 5 | 100.00 | |||
| otbn_stack_addr_integ_chk | 32.000s | 61.431us | 5 | 5 | 100.00 | |
| sec_cm_start_stop_ctrl_state_consistency | 7 | 7 | 100.00 | |||
| otbn_sec_wipe_err | 33.000s | 40.645us | 7 | 7 | 100.00 | |
| sec_cm_data_mem_sec_wipe | 100 | 100 | 100.00 | |||
| otbn_single | 177.000s | 487.413us | 100 | 100 | 100.00 | |
| sec_cm_instruction_mem_sec_wipe | 100 | 100 | 100.00 | |||
| otbn_single | 177.000s | 487.413us | 100 | 100 | 100.00 | |
| sec_cm_data_reg_sw_sec_wipe | 100 | 100 | 100.00 | |||
| otbn_single | 177.000s | 487.413us | 100 | 100 | 100.00 | |
| sec_cm_write_mem_integrity | 9 | 10 | 90.00 | |||
| otbn_multi | 231.000s | 571.665us | 9 | 10 | 90.00 | |
| sec_cm_ctrl_flow_count | 100 | 100 | 100.00 | |||
| otbn_single | 177.000s | 487.413us | 100 | 100 | 100.00 | |
| sec_cm_ctrl_flow_sca | 100 | 100 | 100.00 | |||
| otbn_single | 177.000s | 487.413us | 100 | 100 | 100.00 | |
| sec_cm_data_mem_sw_noaccess | 5 | 5 | 100.00 | |||
| otbn_sw_no_acc | 56.000s | 369.913us | 5 | 5 | 100.00 | |
| sec_cm_key_sideload | 100 | 100 | 100.00 | |||
| otbn_single | 177.000s | 487.413us | 100 | 100 | 100.00 | |
| sec_cm_tlul_fifo_ctr_redun | 5 | 5 | 100.00 | |||
| otbn_sec_cm | 606.000s | 1706.678us | 5 | 5 | 100.00 | |
| Testpoint | Test | Max Runtime | Sim Time | Pass | Total | % |
|---|---|---|---|---|---|---|
| stress_all_with_rand_reset | 0 | 10 | 0.00 | |||
| otbn_stress_all_with_rand_reset | 34.000s | 432.027us | 0 | 10 | 0.00 | |
| Test | seed | line | log context | |
|---|---|---|---|---|
| UVM_FATAL sequencer [SEQDEFPRI] Sequence parent_sequence has illegal priority: -* | 10 test runs | |||
| otbn_stress_all_with_rand_reset | 11188931665714001278444567455477335706834233998796215870791347566682516899360 | 148 |
UVM_INFO @ 12527143 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 17098095695364271418355895136748391042944972402859354943978304153801717462840 | 146 |
UVM_INFO @ 14299849 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 109687171183038915672607074899672021331562414161315254848727870684374005090429 | 158 |
UVM_INFO @ 64780099 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 5015484162162599347284569819272824317368235026670350750626857952891413405586 | 146 |
UVM_INFO @ 37988673 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 113295388539163005900500076600713095272095393916917390775662930281869465124574 | 151 |
UVM_INFO @ 73756116 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 108772410936693024863673620502136519913416528779520875426031150214508337581109 | 159 |
UVM_INFO @ 240797284 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 44240882339533706487526082456432771549279296438292357287693932715032525952614 | 158 |
UVM_INFO @ 86553995 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 21591939516444194800777886902251851794846966825485071607386695062107510550816 | 163 |
UVM_INFO @ 380568241 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 101071091345017204463632925412215524260090962472020474072180758264044334707009 | 177 |
UVM_INFO @ 271909218 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_stress_all_with_rand_reset | 50330049437824625450619540985965278130647876069068471718585090124826715004996 | 157 |
UVM_INFO @ 432026782 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| UVM_ERROR (cip_base_scoreboard.sv:256) scoreboard [scoreboard] alert fatal has unexpected timeout error | 5 test runs | |||
| otbn_alu_bignum_mod_err | 115169410034309549423422410397006098460697332134169100524848307296335442996424 | 122 |
UVM_INFO @ 331134063 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_controller_ispr_rdata_err | 7204586125373034309367712275587581225545096501288847663925839892679799464733 | 109 |
UVM_INFO @ 35283161 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_rf_bignum_intg_err | 93003007401755267745687260913380935566766984914876876603217794534346353725007 | 112 |
UVM_INFO @ 120812900 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_rf_bignum_intg_err | 72087762362543636109731128550271837105580584341483020451441712425593385188935 | 126 |
UVM_INFO @ 186691656 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_escalate | 25197796101724886785219787094660899481288145515650417836775613343871024370432 | 105 |
UVM_INFO @ 150967682 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| UVM_FATAL (otbn_scoreboard.sv:577) scoreboard [scoreboard] We saw a STATUS change * cycles ago that implied we'd get a recov alert but it still hasn't arrived. | 3 test runs | |||
| otbn_multi_err | 81834744713401886044439306423691688918339031519893448242806728271869719720281 | 365 |
UVM_INFO @ 135016450 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_reset | 49520953699364665007911731520469502848553823077631671612660405670390667263585 | 156 |
UVM_INFO @ 495099865 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_multi | 417096024684650534151766330150309124004196160640416666229283191482063888131 | 157 |
UVM_INFO @ 40425626 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| xmsim: *E,ASRTST (/nightly/current_run/scratch/master/otbn-sim-xcelium/default/fusesoc-work/src/lowrisc_dv_otbn_env_*/otbn_insn_cnt_if.sv,21): Assertion InsnCntMatches_A has failed | 3 test runs | |||
| otbn_zero_state_err_urnd | 55602933969754774284062013673665678590365540345846182709391377739529953821590 | 112 |
UVM_ERROR @ 13767270 ps: (otbn_insn_cnt_if.sv:21) [ASSERT FAILED] InsnCntMatches_A
UVM_INFO @ 13767270 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_escalate | 15075347801819072374814719315711971108379053701118449836855430201467507982950 | 115 |
UVM_ERROR @ 85238567 ps: (otbn_insn_cnt_if.sv:21) [ASSERT FAILED] InsnCntMatches_A
UVM_INFO @ 85238567 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| otbn_escalate | 104549875247358424009414079351575372896500980265474551663647849345812260419564 | 117 |
UVM_ERROR @ 62187417 ps: (otbn_insn_cnt_if.sv:21) [ASSERT FAILED] InsnCntMatches_A
UVM_INFO @ 62187417 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|
| xmsim: *E,ASRTST (/nightly/current_run/scratch/master/otbn-sim-xcelium/default/fusesoc-work/src/lowrisc_dv_otbn_sva_*/otbn_idle_checker.sv,196): Assertion NotRunningWhenLocked_A has failed | 1 test run | |||
| otbn_urnd_err | 88885925332143034092002074986070200127155496038872001793151770268397295498398 | 116 |
UVM_ERROR @ 24478772 ps: (otbn_idle_checker.sv:196) [ASSERT FAILED] NotRunningWhenLocked_A
UVM_INFO @ 24478772 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
|
|