Meeting 2024-03-05
- Michael Mustillo
Meeting overview
Meeting Details: Every Tuesday at 6pm CET / 11am CST / 9am PST
Scope: Ensure we are aligned with our goals and on track for conference deadlines
Project Members: @Olivier Cornes@Esma Karagöz@robert karban@Michael Mustillo
Open action items
Review open issues at:
AI4 board - Agile board - JIRA (atlassian.net)
Meeting minutes
Topic Owner | Agenda | Discussion |
|---|---|---|
@Michael Mustillo | Jira Board Review | Please be diligent in keeping Jira up to date, otherwise we waste time in the meeting. |
@Michael Mustillo | MODEL 2024 Needs Strategy for the paper to be finished on time for submission, e.g. who is doing what? | Due March 21, so we should finish it next week. Which means we need to finish the work by next Tuesday the 12th. Draft needs to be completed 15th? Review has done by 19th. |
@robert karban | Metamodel / ontology definition discussion. | Ontology: Mechanism to capture concepts and relationships. Metamodel: similar with subtle differences. Ontology considers the concept. Metamodel means model of a model in order to classify things. Need to understand the classifiers to analyze a system. DON’T SAY PROFILE! May be confused with UML terminology to extend meta-classes of a metamodel… |
@Esma Karagöz @Olivier Cornes | Dataset review vs model | Zonal data doesn’t exist in the AFM. Figure 2: We are only talking about the collection of data and creating knowledge graphs. Issue opened for Olivier to update Figure 2 with KG between step 1 and 2. Need to extract decomposition and interconnection of components. Comparison of natural language vs code based approaches. What’s the metric of evaluation of performance? Seems like F1 may be good for capturing all types of error (false-positive, false-negative, etc…). KG can be created directly from the LLM outputs: https://openmbee.atlassian.net/browse/AI4-28 Need to create the ground truths using dataset in excel: https://docs.google.com/spreadsheets/d/1x3TM1PTgkq02bVGjQ7a6ey0USiqtsuvLbdjzUk8d9aQ/edit?usp=sharing @Olivier Cornes will set up the Jira tasks for everyone for their share of ground truth creation |
@Olivier Cornes | Vienna trip | Tentative March 16th Saturday. Dinner? @Olivier Cornes flights |