Frenetic algorithm excels at SBST Competition!

A team consisting of Ezequiel Castellano, Ahmet Cetinkaya, Cédric Ho Thanh, Stefan Klikovits, Xiaoyi Zhang, and Paolo Arcaini, submitted the Frenetic tool to the CPS testing competition of SBST 2021 which showed good results in terms of diversity and failure generation rate. 


The competition focused on the scenario generation for testing the lane-keeping capabilities of an autonomous driving system, using the BeamNG simulator. The goal was to generate virtual roads that lead to lane-keeping failures (a.k.a. OBEs, for Out-of-Bounds-Errors) within a certain time frame. The submitted tools competed in two distinct configurations, differing in time budget, vehicle configuration, and OBE tolerance.

Frenetic is a genetic approach that leverages a curvature-based road representation, and introduces some nuances aiming at improving diversity of the generated roads.

Implementations were not ranked, but the competition report (in print) states that Frenetic is generally “very effective and triggered many failures“. In fact, Frenetic was among the two tools that “triggered at least 10x more OBEs than the other tools for both configurations”. In particular, Frenetic exposed the most diverse set of failures on average” and found ”the highest number of OBEs for which the ego-car invades the opposite traffic lane”, which might be of particular interest for car manufacturers.* The Frenetic implementation and a description of the algorithm are available in our repository.

Best Paper Award at SSBSE 2020

Dr. Paolo Arcaini has been awarded the best paper award at SSBSE 2020 — 12th Symposium on Search-Based Software Engineering

Paolo Arcaini, Shaukat Ali, Tao Yue:
Do Quality Indicators Prefer Particular Multi-objective Search Algorithms in Search-Based Software Engineering?

Dr. Paolo Arcaini is a Project Associate Professor at NII, and the leader of ERATO MMSD Project, Group 3. 

Best Paper Award (Testing AI System) at AITest 2020

Dr. Paolo Arcaini has been awarded the best paper award (Testing AI System) at AITest 2020— The 2nd IEEE International Conference on Artificial Intelligence Testing.

Paolo Arcaini, Andrea Bombarda, Silvia Bonfanti, Angelo Gargantini:
Dealing with Robustness of Convolutional Neural Networks for Image Classification

Dr. Paolo Arcaini is a Project Associate Professor at NII, and the leader of ERATO MMSD Project, Group 3. 

Three papers (co)-authored by ERATO MMSD researchers accepted for ETAPS 2020

Three papers (co)-authored by ERATO MMSD researchers accepted for presentation at ETAPS 2020 – European Joint Conferences on Theory and Practice of Software.

  • Juraj Kolčák, Jérémy Dubut, Ichiro Hasuo, Shin-Ya Katsumata, David Sprunger and Akihisa Yamada. Relational Differential Dynamic Logic. 26th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS 2020) 
  • Takamasa Okudono and Andy King. Mind the Gap: Bit-vector Interpolation recast over Linear Integer Arithmetic. 26th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS 2020)
  • Satoshi Kura. Graded algebraic theories. 23rd International Conference on Foundations of Software Science and Computation Structures (FoSSaCS 2020)

The European Joint Conferences on Theory and Practice of Software (ETAPS) is the primary European forum for academic and industrial researchers working on topics relating to Software Science. ETAPS, established in 1998, is a confederation of four main annual conferences, ESOPFASEFOSSACS and TACAS, accompanied by satellite workshops and other events. ETAPS 2020 conference was planned in Dublin, Ireland, in April 2020 (postponed due to COVID-19).

Best Paper Award at ICECCS 2019

Dr. Xiaoyi Zhang, Dr. Paolo Arcaini and Dr. Fuyuki Ishikawa have been awarded the best paper award at ICECCS 2019 — the 24th International Conference on Engineering of Complex Computer Systems.

Xiao-Yi Zhang, Paolo Arcaini, Fuyuki Ishikawa:
Assessing the Relation Between Hazards and Variability in Automotive Systems. ICECCS 2019: 190-199. [ieee]

The three authors are members of ERATO MMSD Project (Group 3, led by Fuyuki Ishikawa).

ICECCS is one of the top international conferences in the field of formal methods (CORE rank A). This is the second best paper award in a row at ICECCS from ERATO MMSD, following the last year.

Two papers co-authored by ERATO MMSD researchers accepted for ITSC 2019

Two papers authored by ERATO MMSD researchers accepted for presentation at ITSC 2019 – the 22nd International Conference on Intelligent Transportation Systems.

  • Chao Huang, Boyuan Li, Masako Kishida. Model predictive approach to integrated path planning and tracking for autonomous vehicles. IEEE Intelligent Transportation Systems Conference (ITSC 2019), 2019
    [doi | arxiv]
  • Sasinee Pruekprasert, Xiaoyi Zhang, Jérémy Dubut, Chao Huang. Decision Making for Autonomous Vehicles at Unsignalized Intersection in Presence of Malicious Vehicles. IEEE Intelligent Transportation Systems Conference (ITSC 2019), 2019
    [doi | arxiv]
  • The ITSC Conference is a major international venue on intelligent transportation systems, including automated driving. ITSC 2019 took place in Auckland, New Zealand, in October 2019.

    Two papers co-authored by ERATO MMSD researchers accepted for ICECCS 2019

    Two papers authored by ERATO MMSD researchers accepted for presentation at ICECCS 2019 – the 24th International Conference on Engineering of Complex Computer Systems.

  • Étienne André, Didier Lime, Mathias Ramparison. On the expressive power of invariants in parametric timed automata. The 24th International Conference on Engineering of Complex Computer Systems (ICECCS 2019), pp.87-96, 2019
    [doi]
  • Xiaoyi Zhang, Paolo Arcaini, Fuyuki Ishikawa. Assessing the Relation Between Hazards and Variability in Automotive Systems. The 24th International Conference on Engineering of Complex Computer Systems (ICECCS 2019), pp.190-199, 2019
    [doi]
  • The ICECCS Conference is a premier international venue on system-level quality assurance of computer systems. ICECCS 2019 will take place in Nansha, China, in November 2019.

    Masaki Waga awarded Oded Maler Award for the best paper at FORMATS 2019

    Mr. Masaki Waga has been awarded Oded Maler Award for the best paper at FORMATS 2019 – the 17th International Conference on Formal Modeling and Analysis of Timed Systems – for the following contribution of his.

    Waga M. (2019) Online Quantitative Timed Pattern Matching with Semiring-Valued Weighted Automata. In: André É., Stoelinga M. (eds) Formal Modeling and Analysis of Timed Systems. FORMATS 2019. Lecture Notes in Computer Science, vol 11750. Springer, Cham. [Springer | arxiv]

    Mr. Masaki Waga is a PhD student at SOKENDAI/NII, a JSPS Research Fellow (DC), and a research assistant at ERATO MMSD (Group 3).