FESA3 Tests

Issues to consider, test and check on a fresh FESA3 installation (local in the developer's workspace as well as on test machines as on the asl cluster). To be extended...

FESA3 2.x.x

FESA3 Release on machine	DEV 2.0.1	2.0.1 on vml00v	2.0.1 on asl734	DEV 2.2.2 on asl73x	2.2.2 on vml00v	2.2.2 on asl734	2.3.2* on asl733
Issue
Installation Issues
Installation of gsi-ctr-timing, cern-*, cern-cmw-*, fesa-*, availability for 32-bit				, postponed	, postponed	, postponed
Installation of gsi-ctr-timing, cern-*, cern-cmw-*, fesa-*, availability for 64-bit
Installation of fesa-explorer
Availability of doxygen documentation on webdav server for fesa-core and fesa-core-gsi (visible via https://www-acc.gsi.de/data/documentation/fesa(-gsi)/doxygen/<version>/index.html)
Availability of FESA class / deploy-unit / instantiation documentation on webdav server (visible via e.g. https://www-acc.gsi.de/data/documentation/fesa-gsi/metamodel/<version>/design-doc.html)
Operating System Issues
Availability of user/group fesa (groups; cat /etc/group <pipe>cut -d: -f1; usermod -G fesa <USER>)
Run of post installation script to install the configuration files (*.cfg, *.conf in /common/usr/export/fesa/global/etc/fesa/<VERSION>/)			
Folder permissions set for group fesa in /common/export/fesa
Configuration Issues
CMW directory server environment variables in fesa3_environment.conf					, without network suffix
Eclipse Issues
Proper JAVA version (java -version)		, 1.7.x	, 1.7.x		, 1.8.x	, 1.8.x	1.8.x
Availability Eclipse Kepler SR1 with CDT, Webtools, SVN Connectors						deprecated	deprecated
Availability Eclipse Luna SR1 with CDT
Availability of newest version of FESA3 plugin via (local) update site		local:	local:		local: update site:	update site:	update-site:
Availability of FESA perspective with FESA Browser, Problems View, Workspace, Welcome View, Console View; Project Explorer, Outline, Make Targets					deprecated	deprecated	deprecated
Availability of FESA perspective with views FESA Workspace, Make Targets, Outline, Project Explorer and the Eclipse views Console and Problems		-	-
Availability of FESA3 cheat sheets
FESA3 Eclipse Plug-In Issues
Installation possible via (local) update site		
Configuration of secure storage password
Possibility to configure access to GSI's SVN repository
Possibility to configure FESA preferences			
Availabilty of C++ code templates
Tests for FESA3 classes
Creation of new FESA classes with GSI template
Creation of new FESA classes with empty template
Editing of FESA classes' designs
Display of FESA documentation according to selected element in FESA class design in FESA Browser					deprecated	deprecated	deprecated
Display of FESA documentation according to selected element in FESA class design in FESA doc view	-	-	-
Validation of FESA class designs
Code generation for FESA classes
Availability of desired make targets (32-bit: CPU=i686; 64-bit: CPU=x86_64)					32-bit:, 64-bit:	32-bit:, 64-bit:	32-bit:, 64-bit:
Code compilation of FESA classes for 32-bit					-	-	-
Code compilation of FESA classes for 64-bit
Parallel compile using at least Make option -j4	- produces broken pipes (compile/link will succed if you press it continuously)	not possible on virtual machine	at least once, after a clean broken pipe errors may occur
Creation of base for HTML documentation (.xmldoc)
Creation of HTML documentation
Update of a FESA classes' FESA version (possible only if more than one FESA3 version exists)			
Launch of migration script during update from FESA version 2.0.1 to version 2.2.2	-	-	-				not required
Multiple update of FESA projects (possible only if more than one FESA3 version exists)			
Delivery of FESA classes (relevant for accessability of inheritance/scheduling view)
Automatic SVN integration of new FESA class projects
Creation of log-file FesaPluginTraces.log in users home directory					, bug	, bug
Tests for FESA3 deploy-units
Creation of new FESA deploy-units
Inclusion of a local FESA class
Editing of FESA deploy-unit designs
Display of FESA documentation according to selected element in FESA deploy-unit design in FESA Browser			, Eclipse Browser Bug
Validation of FESA deploy-unit documents
Code generation for FESA deploy-units
Availability of desired make targets (32-bit: CPU=i686; 64-bit: CPU=x86_64)					32-bit:, 64-bit:	32-bit:, 64-bit:	32-bit:, 64-bit:
Code compilation of FESA deploy-units for 32-bit					-	-	-
Code compilation of FESA deploy-units for 64-bit
Parallel compile using at least Make option -j4	see -j4 of class	not possible on virtual machine	at least once, after a clean broken pipe errors may occur
Build complete chain	-	-	-
Creation of FECs (including automatic creation of instance documents)
Creation and adaption of FESA instantiation documents
Promotion of updated FESA class configuration to instantiation document		not tested
Update of a FESA deploy-unit's FESA version including automatic update of instantiation document version (possible only if more than one FESA3 version exists)		( in principle)
Launch of migration script during update from FESA version 2.0.1 to version 2.2.2	-	-	-				not necessary
Creation of start script during source code generation, FEC / instantiation creation and delivery
Delivery of FESA deploy-units including binary, instantiation files and several start scripts (32-bit: CPU=i686)					-	-	-
Delivery of FESA deploy-units including binary, instantiation files and start script (64-bit: CPU=x86_64)
Automatic SVN integration of new FESA deploy-unit projects
Launch of FESA deploy-units on development machine			32-bit: / 64-bit:		64-bit:	64-bit:	64-bit:
Launch of FESA deploy-units on remote location (binary: /common/export/fesa/arch/<CPU>/eqp_software/DU/<state>/...)
Launch of FESA deploy-units on FEC (e.g. SCU)		, e.g. vmla01	(32-bit, scuxl0019) reason: Bug 590
Access running FESA deploy-unit via C++ SimpleClient				Not yet ported to rda3
Access running FESA deploy-unit via FESA Explorer
Tests for operational FESA classes/deploy-units
SVN repository check during delivery		not tested
Warning message if HTML documentation is not existing		not tested			not re-implemented yet	not re-implemented yet	not re-implemented yet
Copying of HTML documentation during delivery to https://www-acc.gsi.de/dav/fesa/classes		not tested			not re-implemented yet	not re-implemented yet	not re-implemented yet
Tests for FESA instantiation documents
Validation of FESA instantiation documents
Editing / Extension of FESA instantiation documents					​
Display of FESA documentation according to selected element in FESA instantiation document in FESA Browser/doc view
Functionality of table editor for device instances (edit values, copy device-instances, edit multiple instances)
Update of a FESA instantiation document's FESA version (possible only if more than one FESA3 version exists)
Launch of migration script during update from FESA version 2.0.1 to version 2.2.2	-	-	-				not required
Launch of FESA Explorer
Creation of zip file containing instantiation document
Update of FESA Explorer (reload zip)
Access of GSI-Standard-Property, e.g. Version via FESA Explorer
Migration from previous version to current version ( package: fesa-core-gsi-integration-test )
GSITemplateIntegrationTest class design	-	-		NA	NA	the migration script was run, however there is a bug: Bug 708	not required for this release
GSITemplateIntegrationTest class deployment-unit	-	-		NA	NA	migration script not run: Bug 709	not required for this release
GSITemplateIntegrationTest class instance-file	-	-		NA	NA	migration script not run: Bug 709	not required for this release
Integration Tests GSI ( package: fesa-core-gsi-integration-test )
GSITemplateIntegrationTest (GSITemplateIntegratTest, GSITemplateIntegratTestDU, !GSITemplateIntegratTest-client) for 32-bit / 64-bit	32-bit /	32-bit: / 64-bit:	32-bit: / 64-bit: , no 64-bit version of local gtest/gmock available	64-bit:	10.04.2015:
InheritanceTest (InheritanceTestBase, InheritanceTestChild, InheritanceTestDU, !InheritanceTest-client) for 32-bit / 64-bit	32-bit /	32-bit: / 64-bit:	32-bit: / 64-bit: , no 64-bit version of local gtest/gmock available	inheritance feature is deactivated for the first	inheritance feature is deactivated for the first	inheritance feature is deactivated for the first	not required for this release, inheritance feature still deactivated
RDADataTypesTest (RDADataTypesTest, RDADataTypesTestDU, !RDADataTypesTest-client) for 32-bit / 64-bit	32-bit /	32-bit: / 64-bit:	32-bit: / 64-bit: , no 64-bit version of local gtest/gmock available	64-bit:
ComposeTest (Compose1, Compose2, ComposeDU, !Compose-client) for 32-bit / 64-bit	32-bit /	32-bit: /	32-bit: / 64-bit: , no 64-bit version of local gtest/gmock available	64-bit:	10.04.2015:
WRTimingTest (WRTimingTest, WRTimingTestDU, !WRTimingTest-client) for 32-bit ( Currently we only have a 32bit Linux on the FEC's)	32-bit	testable only on FECs with White Rabbit based timing	32-bit	64-bit: on scuxl0019	10.04.2015: on scuxl0019	() tests green, but I had to do some things by Hand which should happen automatically: bug 718 + bug 719
Integration Tests Core ( package: fesa-core-integration-test )
FFTCustomEvtSrc ( FFTCustomEvtSrc, FFTCustomEvtSrc_DU, testbed-testsuite) for 32-bit / 64-bit	32-bit /	testsuite does not run	/	64-bit:			not required for this release
FFTEventMapping ( FFTEventMapping, FFTEventMapping_DU, testbed-testsuite) for 32-bit / 64-bit	32-bit /	testsuite does not run	/	64-bit:			not required for this release
FFTEventSources ( FFTEventSources, FFTEventSources_DU, FFTOnSubscriptionSrc, !FFTOnSubscriptionSrc_DU, testbed-testsuite) for 32-bit / 64-bit	32-bit /	testsuite does not run	/	64-bit:			not required for this release

* FESA3 2.3.2 is fully based on FEAS3 2.2.2 . The major change was the replacement of the WR based timing adapter. In FESA3 2.3.2 the timing groups SAFTlib is used, the previous ECA/Etherbone hack has been replaced. Therefore less integration tests had to be run.