The tests are derived from the conformance specification of the api.
For certification it is expected to have a report with all passing tests. There are cases where it is possible to certify a subset of the resources in those cases the ctk is configurable to only run tests against the specific resources.
Original Message:
Sent: Aug 04, 2023 09:33
From: Elzahn Oosthuizen
Subject: Successful Example of CTK test
Hi - also a quick question on this. O we need to implement all the mandatory structures for the test? For example, on TMF620 do we need to implement ProductOffering, ProductOfferingPrice and ProductSpecification? Or can we leave the ProductSpecification out and just not run the test for those? So, then we only pass the test that we run and exclude some test? Or do we need a 100% pass rate on ALL the test on the CTK for API compliance?
------------------------------
Elzahn Oosthuizen
Altron Systems Integration
Original Message:
Sent: Aug 04, 2023 07:30
From: Victor Mari Rodriguez
Subject: Successful Example of CTK test
Yes that is correct. As long as all your tests are passing your results are valid
------------------------------
Victor Mari Rodriguez
TM Forum
Original Message:
Sent: Aug 04, 2023 07:24
From: Rui Ferreira
Subject: Successful Example of CTK test
Thanks for your answer @Victor Rodriguez. So, if I understand correctly, my results are valid and you populate your database before running the tests.
------------------------------
Rui Ferreira
Celfocus
Original Message:
Sent: Aug 04, 2023 07:12
From: Victor Mari Rodriguez
Subject: Successful Example of CTK test
Hi @Rui Ferreira
The reason you are seeing a difference in the tests has to do with the objects present in the collection. That request lists all objects present and runs the same tests for each of them. I had several more object on the database and therefore the ammount of tests increases.
------------------------------
Victor Mari Rodriguez
TM Forum
Original Message:
Sent: Aug 03, 2023 07:19
From: Rui Ferreira
Subject: Successful Example of CTK test
Hello Victor, I'm running the CTK for TMF620 and for now I don't have any error but, I notice by your success file that you have more tests than I. For example, this
run 17 tests and in your file run 116 tests. Can you please clarify why this difference occurs? Why does your file have more tests than my file? Was I'm doing something wrong while running the CTK (I do not change anything in my CTK it's the one that you can download from TMF page)
Thank you for your help
------------------------------
Rui Ferreira
Celfocus
Original Message:
Sent: Aug 02, 2023 07:41
From: Victor Mari Rodriguez
Subject: Successful Example of CTK test
Hi hassan,
I will attach a passing ctk html file. The role of the ctk is to test mandatory attributes in the conformance document of the api. They need to have valid values (If specified by conformance) and be present in the response payloads of your implementation.
------------------------------
Victor Rodriguez
TM Forum
Original Message:
Sent: Jul 26, 2023 05:06
From: Hassan Kamel
Subject: Successful Example of CTK test
I work on CTK test for product catalog but I need some successful examples of html results so I can get more understanding about what are requirements to make the test pass.
------------------------------
Hassan Kamel
Deloitte
------------------------------