Gilles Peskine 
							
						 
					 
					
						
						
							
						
						3ea9450463 
					 
					
						
						
							
							Merge pull request  #8734  from valeriosetti/issue8564  
						
						... 
						
						
						
						Add test for driver-only HMAC 
						
						
					 
					
						2024-02-14 13:43:40 +00:00 
						 
				 
			
				
					
						
							
							
								Ryan Everett 
							
						 
					 
					
						
						
							
						
						67f3568895 
					 
					
						
						
							
							Reduce analyze_block_cipher_dispatch exceptions  
						
						... 
						
						
						
						Signed-off-by: Ryan Everett <ryan.everett@arm.com > 
						
						
					 
					
						2024-02-09 13:02:23 +00:00 
						 
				 
			
				
					
						
							
							
								Ryan Everett 
							
						 
					 
					
						
						
							
						
						afb2eee263 
					 
					
						
						
							
							Add PKCS5/12 exceptions to analyze_block_cipher_dispatch  
						
						... 
						
						
						
						Signed-off-by: Ryan Everett <ryan.everett@arm.com > 
						
						
					 
					
						2024-02-08 14:31:54 +00:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						89d8a12e9c 
					 
					
						
						
							
							analyze_outcomes: fix typo  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2024-01-26 15:04:05 +01:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						cd89b0b536 
					 
					
						
						
							
							all.sh: disable legacy hash support in test_psa_crypto_config_accel_hmac()  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2024-01-24 14:24:55 +01:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						20cea94fd4 
					 
					
						
						
							
							analyze_outcomes: add task for HMAC coverage  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2024-01-22 16:23:25 +01:00 
						 
				 
			
				
					
						
							
							
								Gilles Peskine 
							
						 
					 
					
						
						
							
						
						b1f96c0354 
					 
					
						
						
							
							Merge pull request  #7815  from gilles-peskine-arm/ecp-export-partial  
						
						... 
						
						
						
						ECP keypair utility functions 
						
						
					 
					
						2024-01-18 10:29:05 +00:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						7f48d5e203 
					 
					
						
						
							
							Rename test components to better reflect content  
						
						... 
						
						
						
						Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2024-01-08 11:35:01 +01:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						a0c9c6684d 
					 
					
						
						
							
							analyze_outcomes: ignore only test concerning AES/ARIA/Camellia in CMAC  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2023-12-29 14:14:11 +01:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						0635cca7d1 
					 
					
						
						
							
							analyze_outcomes: update skipped tests following latest changes to all.sh  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2023-12-28 18:33:17 +01:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						ab0494f193 
					 
					
						
						
							
							analyze_outcomes: update comments of skipped tests  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2023-12-28 13:56:52 +01:00 
						 
				 
			
				
					
						
							
							
								Gilles Peskine 
							
						 
					 
					
						
						
							
						
						3b17ae78d2 
					 
					
						
						
							
							Add ECP-heavy-only test cases to the driver parity analysis ignore list  
						
						... 
						
						
						
						Signed-off-by: Gilles Peskine <Gilles.Peskine@arm.com > 
						
						
					 
					
						2023-12-24 19:51:57 +01:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						5f665c3a0d 
					 
					
						
						
							
							analyze_outcomes: add exceptions to disparities for block_cipher dispatch  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2023-12-20 09:56:05 +01:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						9afa329b80 
					 
					
						
						
							
							analyze_outcomes: allow ignored test suites to have a dot in the name  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2023-12-20 09:55:28 +01:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						4a8ef7cd9b 
					 
					
						
						
							
							all.sh: disable legacy AES/ARIA/CAMELLIA in test_full_block_cipher_psa_dispatch  
						
						... 
						
						
						
						This commit also:
- rename the reference component as component_test_full_block_cipher_legacy_dispatch()
- add a common configuration function, named common_block_cipher_dispatch() that
  is used from both accelerated and reference components
Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2023-12-20 07:35:41 +01:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						52ab8fa565 
					 
					
						
						
							
							analyze_outcomes/all.sh: add reference component and entry for coverage comparison  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2023-12-14 18:09:26 +01:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						98a90c6542 
					 
					
						
						
							
							Fix various issue  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-12-07 17:23:25 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						3cd16c47bd 
					 
					
						
						
							
							Add analyze_driver_vs_reference_rsa for analyze_outcomes  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-12-07 10:24:29 +08:00 
						 
				 
			
				
					
						
							
							
								Gilles Peskine 
							
						 
					 
					
						
						
							
						
						18eab984c7 
					 
					
						
						
							
							Merge pull request  #8560  from lpy4105/issue/8423/optimize-analyze_outcomes_py  
						
						... 
						
						
						
						Optimize analyze_outcomes.py 
						
						
					 
					
						2023-11-29 14:51:41 +00:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						5dcfd0c613 
					 
					
						
						
							
							Some improvements  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-29 18:03:28 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						550cd6f9b2 
					 
					
						
						
							
							Use boolean hit instead of int hits  
						
						... 
						
						
						
						Also fix a typo in the comments.
Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-29 09:17:59 +08:00 
						 
				 
			
				
					
						
							
							
								Dave Rodgman 
							
						 
					 
					
						
						
							
						
						c3cd410acf 
					 
					
						
						
							
							Merge pull request  #8286  from gilles-peskine-arm/check_mbedtls_calloc_overallocation-disable_with_asan  
						
						... 
						
						
						
						Fix test_suite_platform failure with Asan on modern Clang 
						
						
					 
					
						2023-11-28 16:48:31 +00:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						451ec8a4bc 
					 
					
						
						
							
							Add comment to read_outcome_file in analyze_outcomes.py  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-28 17:59:05 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						c2e8f3a080 
					 
					
						
						
							
							Add type annotations to analyze_outcomes.py  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-28 17:22:04 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						20e3ca391e 
					 
					
						
						
							
							Run tests for ref_vs_driver outside task function  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-28 15:30:03 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						18908ec276 
					 
					
						
						
							
							Define named tuple for component outcomes  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-28 13:04:11 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						28ae4648a6 
					 
					
						
						
							
							Use mutable set all the time  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-28 11:35:19 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						59b9efc6dd 
					 
					
						
						
							
							Check if driver_component is missing  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-28 11:15:00 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						f28cf594b1 
					 
					
						
						
							
							Break the loop when case hits  
						
						... 
						
						
						
						We don't care about the number of hits of the test cases,
so break the iteration when the case hits.
Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-28 10:56:29 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						dd1d6a7cca 
					 
					
						
						
							
							Improve readability of the script  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-28 10:52:25 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						a1ddcfaef8 
					 
					
						
						
							
							Extend the pattern of pkparse test on encrypted keys  
						
						... 
						
						
						
						These test cases are ignored when analyzing outcomes on
analyze_driver_vs_reference_cipher_aead task.
Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-28 09:46:01 +08:00 
						 
				 
			
				
					
						
							
							
								Gilles Peskine 
							
						 
					 
					
						
						
							
						
						150002c9f9 
					 
					
						
						
							
							Skip calloc overallocation test case  
						
						... 
						
						
						
						This test case is incompatible with sanitizers (e.g. ASan), and thus
skipped. If the driver component uses a sanitizer but the reference
component doesn't, we have a PASS vs SKIP mismatch. Since this test case is
unrelated to drivers, we don't mind ignoring it.
Signed-off-by: Gilles Peskine <Gilles.Peskine@arm.com > 
						
						
					 
					
						2023-11-27 18:24:45 +01:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						31a9b7891a 
					 
					
						
						
							
							Improve comments and variable naming  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-23 14:15:37 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						a442858878 
					 
					
						
						
							
							Restruct the structure of outcome file presentation  
						
						... 
						
						
						
						Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-23 10:52:42 +08:00 
						 
				 
			
				
					
						
							
							
								Pengyu Lv 
							
						 
					 
					
						
						
							
						
						a6cf5d67c5 
					 
					
						
						
							
							Share parsed outcomes among tasks when ananlyzing  
						
						... 
						
						
						
						This extremely improves the performance.
Signed-off-by: Pengyu Lv <pengyu.lv@arm.com > 
						
						
					 
					
						2023-11-23 09:51:58 +08:00 
						 
				 
			
				
					
						
							
							
								Yanray Wang 
							
						 
					 
					
						
						
							
						
						5779096753 
					 
					
						
						
							
							Merge remote-tracking branch 'origin/development' into adjust_tfm_configs  
						
						
						
						
					 
					
						2023-10-31 13:39:07 +08:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						c51c411cc1 
					 
					
						
						
							
							analyze_outcome: only warn on ignored tests that pass  
						
						... 
						
						
						
						The previous check also warned when on tests that were already skipped
in the reference config, which are not really a problem. The purpose of
this "uselessly ignored" check is to make sure that the ignore list
(together with the config common to driver and reference in all.sh)
always correct reflects what works or doesn't in driver-only builds. For
this it's enough to warn when a test is ignored but passing.
The previous, stricter check, was causing issues like:
Error: uselessly ignored: test_suite_pkcs12;PBE Encrypt, pad = 8 (PKCS7 padding disabled)
Error: uselessly ignored: test_suite_pkcs12;PBE Decrypt, (Invalid padding & PKCS7 padding disabled)
Error: uselessly ignored: test_suite_pkcs5;PBES2 Decrypt (Invalid padding & PKCS7 padding disabled)
These are skipped in the reference config because is has PKCS7 padding
enabled, and that's OK.
Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2023-10-30 10:21:22 +01:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						cd84a290a9 
					 
					
						
						
							
							analyze_outcomes: use regexes for cipher/aead  
						
						... 
						
						
						
						Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2023-10-30 10:21:15 +01:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						d36a37f0de 
					 
					
						
						
							
							analyze_outcomes: ignore patterns apply to whole suite  
						
						... 
						
						
						
						This may come in handy when ignoring patterns in test_suite_cipher for
example which is split in several .data files where we'll want to ignore
the same patterns.
Currently none of the entries had a '.' in the test suite name, so this
doesn't change anything for existing entries.
Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2023-10-27 09:19:36 +02:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						9d9c2344ea 
					 
					
						
						
							
							analyze_outcome: Simplify some code  
						
						... 
						
						
						
						Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2023-10-27 09:19:00 +02:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						b26954375f 
					 
					
						
						
							
							analyze_outcome: work around old Python in CI  
						
						... 
						
						
						
						Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2023-10-27 09:18:52 +02:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						62d6131e5e 
					 
					
						
						
							
							analyze_outcomes: minor output fix  
						
						... 
						
						
						
						Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2023-10-27 09:18:52 +02:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						4fd5a6ac9e 
					 
					
						
						
							
							analyze_outcomes: use regexes with ECC components  
						
						... 
						
						
						
						Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2023-10-27 09:18:51 +02:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						b4558bd6e4 
					 
					
						
						
							
							analyze_outcomes: remove useless ignore entries  
						
						... 
						
						
						
						Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2023-10-27 09:17:35 +02:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						371165aec0 
					 
					
						
						
							
							analyze_outcomes: useless ignores are now errors  
						
						... 
						
						
						
						Change from iterating on all available tests to iterating on tests with
an outcome: initially we were iterating on available tests but
immediately ignoring those that were always skipped. That last part
played poorly with the new error (we want to know if the test ignored
due to a pattern was skipped in the reference component), but when
removing it, we were left with iterating on all available tests then
skipping those that don't have outcomes entries: this is equivalent to
iterating on tests with an outcome entry, which is more readable.
Also, give an error if the outcome file contains no passing test from
the reference component: probably means we're using the wrong outcome
file.
Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2023-10-27 09:17:35 +02:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						881ce01db3 
					 
					
						
						
							
							analyze_outcomes: add regex match for ignored tests  
						
						... 
						
						
						
						Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2023-10-27 09:17:35 +02:00 
						 
				 
			
				
					
						
							
							
								Manuel Pégourié-Gonnard 
							
						 
					 
					
						
						
							
						
						4da369f741 
					 
					
						
						
							
							analyze_outcomes: minor code cleanup  
						
						... 
						
						
						
						Signed-off-by: Manuel Pégourié-Gonnard <manuel.pegourie-gonnard@arm.com > 
						
						
					 
					
						2023-10-27 09:17:35 +02:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						507e08f9af 
					 
					
						
						
							
							analyze_outcomes: update cipher/aead data  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2023-10-26 10:05:01 +02:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						97454fde54 
					 
					
						
						
							
							all.sh: accelerate CMAC in test_psa_crypto_config_accel_cipher_aead()  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2023-10-25 12:27:12 +02:00 
						 
				 
			
				
					
						
							
							
								Valerio Setti 
							
						 
					 
					
						
						
							
						
						3b1559060a 
					 
					
						
						
							
							test_suite_psa_crypto: replace builtin dependencies with PSA_WANT  
						
						... 
						
						
						
						Signed-off-by: Valerio Setti <valerio.setti@nordicsemi.no > 
						
						
					 
					
						2023-10-25 12:03:36 +02:00