USBDEV Simulation Results

Sunday March 23 2025 00:10:17 UTC

GitHub Revision: `27fc640f8d`

Branch: master

Simulator: VCS

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	usbdev_smoke	2.750s	207.539us	50	50	100.00
V1	csr_hw_reset	usbdev_csr_hw_reset	4.190s	170.416us	5	5	100.00
V1	csr_rw	usbdev_csr_rw	4.130s	92.890us	20	20	100.00
V1	csr_bit_bash	usbdev_csr_bit_bash	8.640s	1.041ms	5	5	100.00
V1	csr_aliasing	usbdev_csr_aliasing	5.840s	337.077us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	usbdev_csr_mem_rw_with_rand_reset	4.650s	109.376us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	usbdev_csr_rw	4.130s	92.890us	20	20	100.00
		usbdev_csr_aliasing	5.840s	337.077us	5	5	100.00
V1	mem_walk	usbdev_mem_walk	6.410s	635.667us	5	5	100.00
V1	mem_partial_access	usbdev_mem_partial_access	5.210s	194.334us	5	5	100.00
V1		TOTAL			115	115	100.00
V2	in_trans	usbdev_in_trans	3.340s	222.941us	50	50	100.00
V2	data_toggle_clear	usbdev_data_toggle_clear	3.510s	569.203us	50	50	100.00
V2	phy_pins_sense	usbdev_phy_pins_sense	3.120s	31.317us	50	50	100.00
V2	av_buffer	usbdev_av_buffer	2.630s	177.062us	50	50	100.00
V2	rx_fifo	usbdev_pkt_buffer	58.390s	22.086ms	50	50	100.00
V2	phy_config_tx_osc_test_mode	usbdev_phy_config_tx_osc_test_mode	2.390s	325.750us	1	1	100.00
V2	phy_config_eop_single_bit_handling	usbdev_phy_config_eop_single_bit_handling	2.270s	166.372us	1	1	100.00
V2	phy_config_pinflip	usbdev_phy_config_pinflip	2.920s	249.532us	50	50	100.00
V2	phy_config_rand_bus_type	usbdev_phy_config_rand_bus_type	2.880s	255.869us	5	5	100.00
V2	phy_config_rx_dp_dn	usbdev_phy_config_rx_dp_dn	2.690s	238.674us	1	1	100.00
V2	phy_config_tx_use_d_se0	usbdev_phy_config_tx_use_d_se0	2.370s	224.541us	1	1	100.00
V2	phy_config_usb_ref_disable	usbdev_phy_config_usb_ref_disable	3.170s	148.867us	50	50	100.00
V2	max_length_out_transaction	usbdev_max_length_out_transaction	3.090s	238.194us	50	50	100.00
		usbdev_stream_len_max	4.900s	1.142ms	50	50	100.00
V2	max_length_in_transaction	usbdev_max_length_in_transaction	3.500s	278.478us	50	50	100.00
V2	min_length_out_transaction	usbdev_min_length_out_transaction	3.140s	221.698us	50	50	100.00
V2	min_length_in_transaction	usbdev_min_length_in_transaction	3.140s	159.959us	50	50	100.00
V2	random_length_out_transaction	usbdev_random_length_out_transaction	3.180s	183.765us	50	50	100.00
V2	random_length_in_transaction	usbdev_random_length_in_transaction	3.060s	181.986us	50	50	100.00
V2	out_stall	usbdev_out_stall	2.940s	177.850us	50	50	100.00
V2	in_stall	usbdev_in_stall	2.830s	149.380us	50	50	100.00
V2	out_iso	usbdev_out_iso	3.140s	153.393us	50	50	100.00
V2	in_iso	usbdev_in_iso	3.430s	234.836us	50	50	100.00
V2	pkt_received	usbdev_pkt_received	3.310s	269.488us	50	50	100.00
V2	pkt_sent	usbdev_pkt_sent	2.910s	225.564us	50	50	100.00
V2	disconnected	usbdev_disconnected	2.610s	140.433us	50	50	100.00
V2	host_lost	usbdev_host_lost	8.960s	4.172ms	1	1	100.00
V2	link_reset	usbdev_link_reset	2.520s	218.546us	1	1	100.00
V2	link_suspend	usbdev_link_suspend	25.890s	10.513ms	50	50	100.00
V2	link_resume	usbdev_link_resume	54.770s	29.492ms	50	50	100.00
V2	av_empty	usbdev_av_empty	2.510s	210.128us	5	5	100.00
V2	rx_full	usbdev_rx_full	3.430s	360.716us	50	50	100.00
V2	av_overflow	usbdev_av_overflow	2.470s	154.411us	5	5	100.00
V2	link_in_err	usbdev_link_in_err	3.000s	239.154us	50	50	100.00
V2	rx_crc_err	usbdev_rx_crc_err	2.920s	182.123us	50	50	100.00
V2	rx_pid_err	usbdev_rx_pid_err	2.360s	181.758us	5	5	100.00
V2	rx_bitstuff_err	usbdev_bitstuff_err	2.670s	192.601us	50	50	100.00
V2	link_out_err	usbdev_link_out_err	3.260s	467.068us	1	1	100.00
V2	enable	usbdev_enable	2.350s	41.103us	50	50	100.00
V2	resume_link_active	usbdev_resume_link_active	37.140s	20.161ms	20	20	100.00
V2	device_address	usbdev_device_address	1.494m	47.228ms	50	50	100.00
V2	invalid_data1_data0_toggle_test	usbdev_invalid_data1_data0_toggle_test	2.370s	558.515us	1	1	100.00
V2	setup_stage	usbdev_setup_stage	2.680s	156.884us	50	50	100.00
V2	endpoint_access	usbdev_endpoint_access	4.480s	854.537us	50	50	100.00
V2	disable_endpoint	usbdev_disable_endpoint	4.650s	1.163ms	50	50	100.00
V2	endpoint_types	usbdev_endpoint_types	3.370s	606.063us	200	200	100.00
V2	out_trans_nak	usbdev_out_trans_nak	3.120s	180.858us	50	50	100.00
V2	setup_trans_ignored	usbdev_setup_trans_ignored	2.950s	146.663us	50	50	100.00
V2	nak_trans	usbdev_nak_trans	3.000s	253.932us	50	50	100.00
V2	stall_trans	usbdev_stall_trans	2.630s	183.638us	50	50	100.00
V2	setup_priority_over_stall_response	usbdev_setup_priority_over_stall_response	2.570s	310.288us	5	5	100.00
V2	stall_priority_over_nak	usbdev_stall_priority_over_nak	2.770s	176.501us	50	50	100.00
V2	pending_in_trans	usbdev_pending_in_trans	3.020s	152.932us	50	50	100.00
V2	streaming_test	usbdev_streaming_out	1.467m	4.131ms	50	50	100.00
V2	max_clock_error_untracked	usbdev_freq_hiclk	2.595m	87.178ms	5	5	100.00
		usbdev_freq_loclk	2.764m	90.145ms	5	5	100.00
V2	max_clock_error_tracking	usbdev_freq_hiclk_max	2.613m	90.293ms	5	5	100.00
		usbdev_freq_loclk_max	3.416m	108.076ms	5	5	100.00
V2	max_phase_error	usbdev_freq_phase	2.910m	115.159ms	5	5	100.00
V2	min_inter_pkt_delay	usbdev_min_inter_pkt_delay	1.664m	3.989ms	50	50	100.00
V2	max_inter_pkt_delay	usbdev_max_inter_pkt_delay	1.753m	4.284ms	50	50	100.00
V2	device_timeout_missing_host_handshake	usbdev_timeout_missing_host_handshake	53.660s	7.891ms	50	50	100.00
V2	device_timeout	usbdev_device_timeout	42.260s	7.062ms	50	50	100.00
V2	packet_buffer	usbdev_pkt_buffer	58.390s	22.086ms	50	50	100.00
V2	nak_to_out_trans_when_avbuffer_empty_rxfifo_full	usbdev_nak_to_out_trans_when_avbuffer_empty_rxfifo_full	3.430s	516.812us	1	1	100.00
V2	aon_wake_resume	usbdev_aon_wake_resume	45.970s	30.366ms	50	50	100.00
V2	aon_wake_reset	usbdev_aon_wake_reset	39.310s	20.961ms	50	50	100.00
V2	aon_wake_disconnect	usbdev_aon_wake_disconnect	18.240s	10.685ms	50	50	100.00
V2	invalid_sync	usbdev_invalid_sync	2.241m	5.049ms	50	50	100.00
V2	spurious_pids_ignored	usbdev_spurious_pids_ignored	1.153m	3.352ms	50	50	100.00
V2	low_speed_traffic	usbdev_low_speed_traffic	1.899m	5.946ms	50	50	100.00
V2	rand_bus_resets	usbdev_rand_bus_resets	1.480m	7.649ms	10	10	100.00
V2	rand_disconnects	usbdev_rand_bus_disconnects	1.428m	7.427ms	10	10	100.00
V2	rand_suspends	usbdev_rand_suspends	2.525m	9.653ms	10	10	100.00
V2	max_usb_traffic	usbdev_max_non_iso_usb_traffic	1.251m	3.786ms	25	25	100.00
		usbdev_max_usb_traffic	1.157m	3.233ms	15	15	100.00
V2	stress_usb_traffic	usbdev_stress_usb_traffic	2.286m	7.331ms	10	10	100.00
V2	in_packet_retraction	usbdev_iso_retraction	1.811m	12.096ms	50	50	100.00
V2	data_toggle_restore	usbdev_data_toggle_restore	6.080s	1.276ms	50	50	100.00
V2	setup_priority	usbdev_setup_priority	3.130s	458.856us	5	5	100.00
V2	fifo_resets	usbdev_fifo_rst	4.670s	527.995us	50	50	100.00
V2	tx_rx_disruption	usbdev_tx_rx_disruption	5.100s	674.562us	498	500	99.60
V2	fifo_levels	usbdev_fifo_levels	3.290s	256.467us	158	160	98.75
V2	intr_test	usbdev_intr_test	4.010s	99.837us	50	50	100.00
V2	alert_test	usbdev_alert_test	2.340s	55.837us	50	50	100.00
V2	tl_d_oob_addr_access	usbdev_tl_errors	5.790s	240.912us	20	20	100.00
V2	tl_d_illegal_access	usbdev_tl_errors	5.790s	240.912us	20	20	100.00
V2	tl_d_outstanding_access	usbdev_csr_hw_reset	4.190s	170.416us	5	5	100.00
		usbdev_csr_rw	4.130s	92.890us	20	20	100.00
		usbdev_csr_aliasing	5.840s	337.077us	5	5	100.00
		usbdev_same_csr_outstanding	4.740s	240.027us	20	20	100.00
V2	tl_d_partial_access	usbdev_csr_hw_reset	4.190s	170.416us	5	5	100.00
		usbdev_csr_rw	4.130s	92.890us	20	20	100.00
		usbdev_csr_aliasing	5.840s	337.077us	5	5	100.00
		usbdev_same_csr_outstanding	4.740s	240.027us	20	20	100.00
V2		TOTAL			3760	3764	99.89
V2S	tl_intg_err	usbdev_sec_cm	3.090s	614.336us	5	5	100.00
		usbdev_tl_intg_err	12.750s	10.515ms	19	20	95.00
V2S	sec_cm_bus_integrity	usbdev_tl_intg_err	12.750s	10.515ms	19	20	95.00
V2S		TOTAL			24	25	96.00
V3	dpi_config_host	usbdev_dpi_config_host	1.998m	5.114ms	1	1	100.00
V3		TOTAL			1	1	100.00
	Unmapped tests	usbdev_stress_all_with_rand_reset	2.210s	69.086us	0	10	0.00
		usbdev_stress_all	2.270s		0	50	0.00
		TOTAL			3900	3965	98.36

Coverage Results

Coverage Dashboard

SCORE	LINE	COND	TOGGLE	FSM	BRANCH	ASSERT	GROUP
97.11	98.58	95.77	97.23	93.22	98.36	98.03	98.55

Failure Buckets

UVM_WARNING [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory. has 60 failures:

Test usbdev_stress_all_with_rand_reset has 10 failures.

0.usbdev_stress_all_with_rand_reset.108977718423953086011004820955117915146389351190302400885745286188469155683677
Line 74, in log /nightly/runs/scratch/master/usbdev-sim-vcs/0.usbdev_stress_all_with_rand_reset/latest/run.log

  UVM_WARNING @  13827932 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
  UVM_INFO @  13827932 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
  #### Factory Configuration (*)

  No instance overrides are registered with this factory

1.usbdev_stress_all_with_rand_reset.9327817207013729807673547167491833901564647121520290930863287095045236688984
Line 74, in log /nightly/runs/scratch/master/usbdev-sim-vcs/1.usbdev_stress_all_with_rand_reset/latest/run.log

  UVM_WARNING @  16060622 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
  UVM_INFO @  16060622 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
  #### Factory Configuration (*)

  No instance overrides are registered with this factory

... and 8 more failures.

Test usbdev_stress_all has 50 failures.

0.usbdev_stress_all.93381129846496469477520234963803947200399924984197121500742895786106035807389
Line 73, in log /nightly/runs/scratch/master/usbdev-sim-vcs/0.usbdev_stress_all/latest/run.log

  UVM_WARNING @         0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
  UVM_INFO @         0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
  #### Factory Configuration (*)

  No instance overrides are registered with this factory

1.usbdev_stress_all.28773915802438977063692400796535875231141471317020387478212191890031088193549
Line 73, in log /nightly/runs/scratch/master/usbdev-sim-vcs/1.usbdev_stress_all/latest/run.log

  UVM_WARNING @         0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
  UVM_INFO @         0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
  #### Factory Configuration (*)

  No instance overrides are registered with this factory

... and 48 more failures.

UVM_ERROR (usbdev_fifo_levels_vseq.sv:173) [usbdev_fifo_levels_vseq] Check failed get_field_val(ral.usbstat.av_out_depth, usbstat) == exp_avout_level (* [*] vs * [*]) has 2 failures:

Test usbdev_fifo_levels has 2 failures.

87.usbdev_fifo_levels.44187072478925650851504799588205259833191946393760036187894630557055123110988
Line 109, in log /nightly/runs/scratch/master/usbdev-sim-vcs/87.usbdev_fifo_levels/latest/run.log

  UVM_ERROR @ 152883344 ps: (usbdev_fifo_levels_vseq.sv:173) [uvm_test_top.env.virtual_sequencer.usbdev_fifo_levels_vseq] Check failed get_field_val(ral.usbstat.av_out_depth, usbstat) == exp_avout_level (1 [0x1] vs 0 [0x0])
  UVM_INFO @ 152883344 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

129.usbdev_fifo_levels.72439652470086997161819854441055572242823551944543074856910505068389175338704
Line 103, in log /nightly/runs/scratch/master/usbdev-sim-vcs/129.usbdev_fifo_levels/latest/run.log

  UVM_ERROR @ 128761394 ps: (usbdev_fifo_levels_vseq.sv:173) [uvm_test_top.env.virtual_sequencer.usbdev_fifo_levels_vseq] Check failed get_field_val(ral.usbstat.av_out_depth, usbstat) == exp_avout_level (8 [0x8] vs 7 [0x7])
  UVM_INFO @ 128761394 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

UVM_ERROR (usbdev_scoreboard.sv:261) [scoreboard] Check failed expected_rsp_q.size() > * (* [*] vs * [*]) Unexpected response from DUT; no expectation ready has 2 failures:
- Test usbdev_tx_rx_disruption has 2 failures.
  - 106.usbdev_tx_rx_disruption.97279219427914024827774964956351802525123341714152648995198611489445828268430
    Line 180, in log /nightly/runs/scratch/master/usbdev-sim-vcs/106.usbdev_tx_rx_disruption/latest/run.log
```
  UVM_ERROR @ 241983945 ps: (usbdev_scoreboard.sv:261) [uvm_test_top.env.scoreboard] Check failed expected_rsp_q.size() > 0 (0 [0x0] vs 0 [0x0]) Unexpected response from DUT; no expectation ready
  UVM_INFO @ 241983945 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
  - 271.usbdev_tx_rx_disruption.106930578882735386451366691081468462361327304048018430315918646385080748412241
    Line 177, in log /nightly/runs/scratch/master/usbdev-sim-vcs/271.usbdev_tx_rx_disruption/latest/run.log
```
  UVM_ERROR @ 206102988 ps: (usbdev_scoreboard.sv:261) [uvm_test_top.env.scoreboard] Check failed expected_rsp_q.size() > 0 (0 [0x0] vs 0 [0x0]) Unexpected response from DUT; no expectation ready
  UVM_INFO @ 206102988 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (cip_base_vseq.sv:665) [usbdev_common_vseq] timeout wait for alert handshake:fatal_fault has 1 failures:
- Test usbdev_tl_intg_err has 1 failures.
  - 0.usbdev_tl_intg_err.977878622554594234632082782252292826548046235692011732112000076224560153783
    Line 159, in log /nightly/runs/scratch/master/usbdev-sim-vcs/0.usbdev_tl_intg_err/latest/run.log
```
  UVM_FATAL @ 10514930273 ps: (cip_base_vseq.sv:665) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] timeout wait for alert handshake:fatal_fault
  UVM_INFO @ 10514930273 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```