Case Overview

Over the past years, many authors have contributed case studies for the TTC, creating a set of community-established benchmarks for model transformation tools. The following table provides an overview.

Benchmark Year Topic Evaluation Criteria
FIXML to Java, C# and C++ 2014
  • transformation
  • correctness
  • maintainability
  • understandability
  • conciseness
Train Benchmark 2015
  • incremental change propagation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • initial runtime
  • change propagation time
  • scalability
Class Responsibility Assignment 2016
  • search-based optimization
  • correctness
  • maintainability
  • understandability
  • conciseness
  • quality of results
  • runtime
Dataflow 2016
  • transformation
  • incremental change propagation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • initial runtime
  • change propagation time
  • scalability
Smart Grids 2017
  • transformation
  • incremental change propagation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • initial runtime
  • change propagation time
  • scalability
Families to Persons 2017
  • bidirectional transformation
  • incremental change propagation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • initial runtime
  • change propagation time
  • scalability
State Elimination 2017
  • destructive transformation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • runtime
  • scalability
Transformation Reuse 2017
  • reuse
  • correctness
  • maintainability
  • understandability
  • conciseness
  • runtime
  • reuse
Quality-based Software Selection and Hardware-Mapping 2018
  • search-based optimization
  • correctness
  • maintainability
  • understandability
  • conciseness
  • runtime
  • quality of results
  • scalability
Social Media 2018
  • incremental change propagation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • initial runtime
  • change propagation time
Truth tables to BDD 2019
  • open to any research direction
  • correctness
  • maintainability
  • understandability
  • conciseness
BibtexXML to Docbook 2019
  • bidirectional transformation
  • correctness
  • maintainability
  • understandability
  • conciseness
Roundtrip 2020
  • bidirectional transformation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • reuse
Incremental Workflows 2021
  • incremental change propagation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • initial runtime
  • change propagation time
  • scalability
OCL2PSQL 2021
  • transformation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • runtime
  • quality of results
Containers to MiniYAML 2023
  • bidirectional transformation
  • incremental change propagation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • scalability
  • initial runtime
  • change propagation time
KMEHR to FHIR 2023
  • bidirectional transformation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • runtime
  • scalability
Incremental Class into Relational 2023
  • incremental change propagation
  • correctness
  • maintainability
  • understandability
  • conciseness
  • initial runtime
  • change propagation time