A team consisting of Ezequiel Castellano, Ahmet Cetinkaya, Cédric Ho Thanh, Stefan Klikovits, Xiaoyi Zhang, and Paolo Arcaini, submitted the Frenetic tool to the CPS testing competition of SBST 2021 which showed good results in terms of diversity and failure generation rate.
The competition focused on the scenario generation for testing the lane-keeping capabilities of an autonomous driving system, using the BeamNG simulator. The goal was to generate virtual roads that lead to lane-keeping failures (a.k.a. OBEs, for Out-of-Bounds-Errors) within a certain time frame. The submitted tools competed in two distinct configurations, differing in time budget, vehicle configuration, and OBE tolerance.
Frenetic is a genetic approach that leverages a curvature-based road representation, and introduces some nuances aiming at improving diversity of the generated roads.
Implementations were not ranked, but the competition report (in print) states that Frenetic is generally “very effective and triggered many failures“. In fact, Frenetic was among the two tools that “triggered at least 10x more OBEs than the other tools for both configurations”. In particular, “Frenetic exposed the most diverse set of failures on average” and found ”the highest number of OBEs for which the ego-car invades the opposite traffic lane”, which might be of particular interest for car manufacturers.* The Frenetic implementation and a description of the algorithm are available in our repository.
Three papers (co)-authored by ERATO MMSD researchers accepted for presentation at ETAPS 2020 – European Joint Conferences on Theory and Practice of Software.
Juraj Kolčák, Jérémy Dubut, Ichiro Hasuo, Shin-Ya Katsumata, David Sprunger and Akihisa Yamada. Relational Differential Dynamic Logic. 26th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS 2020)
Takamasa Okudono and Andy King. Mind the Gap: Bit-vector Interpolation recast over Linear Integer Arithmetic. 26th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS 2020)
Satoshi Kura. Graded algebraic theories. 23rd International Conference on Foundations of Software Science and Computation Structures (FoSSaCS 2020)
The European Joint Conferences on Theory and Practice of Software (ETAPS) is the primary European forum for academic and industrial researchers working on topics relating to Software Science. ETAPS, established in 1998, is a confederation of four main annual conferences, ESOP, FASE, FOSSACS and TACAS, accompanied by satellite workshops and other events. ETAPS 2020 conference was planned in Dublin, Ireland, in April 2020 (postponed due to COVID-19).
Two papers authored by ERATO MMSD researchers accepted for presentation at ICECCS 2019 – the 24th International Conference on Engineering of Complex Computer Systems.
Étienne André, Didier Lime, Mathias Ramparison. On the expressive power of invariants in parametric timed automata. The 24th International Conference on Engineering of Complex Computer Systems (ICECCS 2019), pp.87-96, 2019 [doi]
Xiaoyi Zhang, Paolo Arcaini, Fuyuki Ishikawa. Assessing the Relation Between Hazards and Variability in Automotive Systems. The 24th International Conference on Engineering of Complex Computer Systems (ICECCS 2019), pp.190-199, 2019 [doi]
The ICECCS Conference is a premier international venue on system-level quality assurance of computer systems. ICECCS 2019 will take place in Nansha, China, in November 2019.
Mr. Masaki Waga has been awarded Oded Maler Award for the best paper at FORMATS 2019 – the 17th International Conference on Formal Modeling and Analysis of Timed Systems – for the following contribution of his.
Waga M. (2019) Online Quantitative Timed Pattern Matching with Semiring-Valued Weighted Automata. In: André É., Stoelinga M. (eds) Formal Modeling and Analysis of Timed Systems. FORMATS 2019. Lecture Notes in Computer Science, vol 11750. Springer, Cham. [Springer | arxiv]
Mr. Masaki Waga is a PhD student at SOKENDAI/NII, a JSPS Research Fellow (DC), and a research assistant at ERATO MMSD (Group 3).