Skip to content

FST MC->Raw files are produced by CRU end point#9834

Merged
martenole merged 1 commit into
AliceO2Group:devfrom
martenole:fst
Sep 21, 2022
Merged

FST MC->Raw files are produced by CRU end point#9834
martenole merged 1 commit into
AliceO2Group:devfrom
martenole:fst

Conversation

@martenole
Copy link
Copy Markdown
Contributor

@martenole martenole commented Sep 15, 2022

When creating new synthetic data samples we noticed inconsistencies in the option naming scheme of different detectors.
By default, when creating raw data for readout at P2 we require the files per CRU end point. Thus the option cru used by most detectors to describe this has been changed to cruendpoint.
For HMPID I use crorcendpoint instead of cru. I did not use link as the other CROC detectors do, because that option is used by something else for HMPID.
Please let me know in case you have comments or prefer to keep the options as they are now. There was some initial discussion in #9822

@alibuild
Copy link
Copy Markdown
Collaborator

alibuild commented Sep 15, 2022 •
edited
Loading

Error while checking build/O2/fullCI for 33c16e5 at 2022-09-16 10:51:

## sw/BUILD/o2checkcode-latest/log
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/Common/test/testGPUsortCUDA.cu:22:10: error: 'boost/test/unit_test.hpp' file not found [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUTracking/TRDTracking/GPUTRDTracker.cxx:37:10: error: 'omp.h' file not found [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUTracking/Base/GPUReconstruction.cxx:37:10: error: 'omp.h' file not found [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUTracking/Base/GPUReconstructionCPU.cxx:45:10: error: 'omp.h' file not found [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUTracking/Base/cuda/GPUReconstructionCUDAGenRTC.cu:16:10: error: 'omp.h' file not found [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/cuda/../Shared/Utils.h:26:10: error: 'boost/program_options.hpp' file not found [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/cuda/../Shared/Utils.h:26:10: error: 'boost/program_options.hpp' file not found [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUTracking/display/GPUDisplay.cxx:36:10: error: 'omp.h' file not found [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/Framework/Logger/include/Framework/Logger.h:14:10: error: 'fairlogger/Logger.h' file not found [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:520:12: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:1059:69: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:1175:5: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:1852:16: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:2276:18: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:4336:16: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/sm_20_atomic_functions.h:89:39: error: redefinition of 'atomicAdd' [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/Framework/Logger/include/Framework/Logger.h:14:10: error: 'fairlogger/Logger.h' file not found [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:520:12: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:1059:69: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:1175:5: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:1852:16: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:2276:18: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/cuda/std/detail/libcxx/include/type_traits:4336:16: error: CUDA device code does not support variadic functions [clang-diagnostic-error]
/usr/local/cuda-11.7/include/sm_20_atomic_functions.h:89:39: error: redefinition of 'atomicAdd' [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/../Shared/Utils.h:146:34: error: use of undeclared identifier 'int4'; did you mean 'int'? [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:64:8: error: unknown type name '__host__' [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:64:27: error: expected ';' after top level declarator [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:64:33: error: overloaded 'operator+=' must have at least one parameter of class or enumeration type [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:64:44: error: unknown type name 'int4'; did you mean 'int'? [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:64:53: error: unknown type name 'int4'; did you mean 'int'? [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:66:4: error: member reference base type 'int' is not a structure or union [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:66:11: error: member reference base type 'int' is not a structure or union [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:67:4: error: member reference base type 'int' is not a structure or union [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:67:11: error: member reference base type 'int' is not a structure or union [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:68:4: error: member reference base type 'int' is not a structure or union [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:68:11: error: member reference base type 'int' is not a structure or union [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:69:4: error: member reference base type 'int' is not a structure or union [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:69:11: error: member reference base type 'int' is not a structure or union [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:85:1: error: unknown type name '__global__' [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:90:19: error: use of undeclared identifier 'blockIdx' [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:90:32: error: use of undeclared identifier 'blockDim' [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:90:45: error: use of undeclared identifier 'threadIdx' [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/Kernels.hip.cxx:90:78: error: use of undeclared identifier 'blockDim' [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/../Shared/Utils.h:146:34: error: use of undeclared identifier 'int4'; did you mean 'int'? [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/GPU/GPUbenchmark/hip/benchmark.hip.cxx:199:35: error: use of undeclared identifier 'int4'; did you mean 'int'? [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/Detectors/EMCAL/calibration/include/EMCALCalibration/EMCALCalibExtractor.h:34:10: error: 'omp.h' file not found [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/Detectors/EMCAL/calibration/include/EMCALCalibration/EMCALCalibExtractor.h:34:10: error: 'omp.h' file not found [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/Detectors/EMCAL/calibration/include/EMCALCalibration/EMCALCalibExtractor.h:34:10: error: 'omp.h' file not found [clang-diagnostic-error]
/sw/SOURCES/O2/9834-slc8_x86-64/0/Detectors/TOF/calibration/src/TOFChannelCalibrator.cxx:23:10: error: 'omp.h' file not found [clang-diagnostic-error]

Full log here.

@alibuild
Copy link
Copy Markdown
Collaborator

alibuild commented Sep 16, 2022 •
edited
Loading

Error while checking build/O2/o2-dataflow for 33c16e5 at 2022-09-21 08:11:

## sw/BUILD/O2-latest/log
100% tests passed, 0 tests failed out of 427
 93/106 Test #107: test_Framework_test_SingleDataSource ....................***Failed    2.22 sec
[ERROR] pid 17418 (internal-dpl-injected-dummy-sink) crashed with 1
[ERROR] SEVERE: Device internal-dpl-injected-dummy-sink (17418) returned with 1
99% tests passed, 1 tests failed out of 102

Full log here.

@alibuild
Copy link
Copy Markdown
Collaborator

alibuild commented Sep 17, 2022 •
edited
Loading

Error while checking build/O2/o2 for 33c16e5 at 2022-09-21 05:57:

## sw/BUILD/O2-latest/log
 93/450 Test  #90: CCDB/test/testCcdbApi.cxx ............................................................***Failed    2.00 sec
[ERROR] Couldn't retrieve object corresponding to o2::utils::RootChain from TFile
[ERROR] Requested resource does not exist: http://ccdb-test.cern.ch:8080/Test/TestCcdbApi/aliflow01.cern.ch/pid17040//1663732095907/
[ERROR] Unable to find object Test/TestCcdbApi/aliflow01.cern.ch/pid17040//1663732095907, Aborting
[ERROR] Requested resource does not exist: http://ccdb-test.cern.ch:8080/Test/TestCcdbApi/aliflow01.cern.ch/pid17040/CCDBPathUnitTest/999/Hello=World/
[ERROR] Requested resource does not exist: http://ccdb-test.cern.ch:8080/Test/TestCcdbApi/aliflow01.cern.ch/pid17040/CCDBPathUnitTest/1010/Hello=World/
[ERROR] Requested resource does not exist: http://ccdb-test.cern.ch:8080/Test/TestCcdbApi/aliflow01.cern.ch/pid17040/graph/1663732096188/Hello=World/
/sw/SOURCES/O2/9834-slc7_x86-64/0/CCDB/test/testCcdbApi.cxx(289): �[1;31;49merror: in "retrieveTMemFile_test": check obj != nullptr has failed [0 == nullptr]�[0;39;49m
99% tests passed, 1 tests failed out of 450
100% tests passed, 0 tests failed out of 102

Full log here.

@alibuild
Copy link
Copy Markdown
Collaborator

alibuild commented Sep 17, 2022

Error while checking build/AliceO2/O2/o2/macOS-arm for 33c16e5 at 2022-09-18 00:08:

## sw/BUILD/O2-latest/log
 86/449 Test  #90: CCDB/test/testCcdbApi_ConfigParam.cxx ................................................***Failed    2.19 sec
[ERROR] Requested resource does not exist: http://ccdb-test.cern.ch:8080/GLO/Config/PVertexer/1663452110428/
/System/Volumes/Data/build/nomad/alloc/627e7c3c-41b1-6bbb-b5b0-3fab21115acf/ci/local/o2/sw/SOURCES/O2/9834/0/CCDB/test/testCcdbApi_ConfigParam.cxx:131: �[1;31;49merror: in "testConfigParamRetrieval": check object != nullptr has failed�[0;39;49m
/System/Volumes/Data/build/nomad/alloc/627e7c3c-41b1-6bbb-b5b0-3fab21115acf/ci/local/o2/sw/SOURCES/O2/9834/0/CCDB/test/testCcdbApi_ConfigParam.cxx:133: �[1;31;49merror: in "testConfigParamRetrieval": check object->getMemberProvenance("useMeanVertexConstraint") == o2::conf::ConfigurableParam::EParamProvenance::kCCDB has failed�[0;39;49m
/System/Volumes/Data/build/nomad/alloc/627e7c3c-41b1-6bbb-b5b0-3fab21115acf/ci/local/o2/sw/SOURCES/O2/9834/0/CCDB/test/testCcdbApi_ConfigParam.cxx:135: �[1;31;49merror: in "testConfigParamRetrieval": check p1.getMemberProvenance("useMeanVertexConstraint") == o2::conf::ConfigurableParam::EParamProvenance::kCCDB has failed�[0;39;49m
/System/Volumes/Data/build/nomad/alloc/627e7c3c-41b1-6bbb-b5b0-3fab21115acf/ci/local/o2/sw/SOURCES/O2/9834/0/CCDB/test/testCcdbApi_ConfigParam.cxx:136: �[1;31;49merror: in "testConfigParamRetrieval": check object == &p1 has failed�[0;39;49m
99% tests passed, 1 tests failed out of 449
100% tests passed, 0 tests failed out of 101

Full log here.

@martenole
Copy link
Copy Markdown
Contributor Author

martenole commented Sep 20, 2022

If there are no comments or objections I would merge this tomorrow

@martenole
Copy link
Copy Markdown
Contributor Author

martenole commented Sep 21, 2022

Failure unrelated and all checks were green before, merging

@martenole martenole merged commit 11e3862 into AliceO2Group:dev Sep 21, 2022
@davidrohr
Copy link
Copy Markdown
Collaborator

davidrohr commented Oct 11, 2022 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bazinski bazinski bazinski approved these changes

@davidrohr davidrohr davidrohr approved these changes

@rpezzi rpezzi rpezzi approved these changes

@f3sch f3sch Awaiting requested review from f3sch f3sch is a code owner

@tdietel tdietel Awaiting requested review from tdietel

@wiechula wiechula Awaiting requested review from wiechula wiechula is a code owner

@shahor02 shahor02 Awaiting requested review from shahor02 shahor02 is a code owner

@noferini noferini Awaiting requested review from noferini noferini is a code owner

@iouribelikov iouribelikov Awaiting requested review from iouribelikov

@bovulpes bovulpes Awaiting requested review from bovulpes

@mconcas mconcas Awaiting requested review from mconcas mconcas is a code owner

@jotwinow jotwinow Awaiting requested review from jotwinow jotwinow is a code owner

@afurs afurs Awaiting requested review from afurs afurs is a code owner

@andreasmolander andreasmolander Awaiting requested review from andreasmolander andreasmolander is a code owner

@arvindkhuntia arvindkhuntia Awaiting requested review from arvindkhuntia

@mslupeck mslupeck Awaiting requested review from mslupeck

@peressounko peressounko Awaiting requested review from peressounko peressounko is a code owner

@kharlov kharlov Awaiting requested review from kharlov kharlov is a code owner

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@martenole @alibuild @davidrohr @bazinski @rpezzi