Informed personas by jonas-becker · Pull Request #156 · Multi-Agent-LLMs/mallm

jonas-becker · 2026-10-10T09:30:34Z

add context to individual agents

…Ms/mallm into informed_personas

github-actions · 2026-10-10T09:36:06Z

Coverage Report

Name                                                        Stmts   Miss Branch BrPart  Cover
---------------------------------------------------------------------------------------------
mallm/__init__.py                                               1      0      0      0   100%
mallm/agents/__init__.py                                        0      0      0      0   100%
mallm/agents/agent.py                                          90     46     20      3    45%
mallm/agents/draftProposer.py                                  11      1      2      1    85%
mallm/agents/judge.py                                          59     59     20      0     0%
mallm/agents/panelist.py                                       11      6      2      0    38%
mallm/coordinator.py                                          163     74     54      7    52%
mallm/decision_protocols/__init__.py                            0      0      0      0   100%
mallm/decision_protocols/approval_voting.py                    47     31     10      0    28%
mallm/decision_protocols/consensus.py                          52     11     10      1    74%
mallm/decision_protocols/consensus_voting.py                   74     56     20      0    19%
mallm/decision_protocols/cumulative_voting.py                  57     39     18      0    24%
mallm/decision_protocols/judge.py                              29     14      4      0    45%
mallm/decision_protocols/protocol.py                          150    117     60      1    16%
mallm/decision_protocols/ranked_voting.py                      45     30     12      0    26%
mallm/decision_protocols/simple_voting.py                     103     25     52      8    74%
mallm/discussion_paradigms/__init__.py                          0      0      0      0   100%
mallm/discussion_paradigms/collective_refinement.py            61     46     14      1    21%
mallm/discussion_paradigms/debate.py                           85     70     36      1    13%
mallm/discussion_paradigms/memory.py                           20      7      2      1    64%
mallm/discussion_paradigms/paradigm.py                         91     71     30      1    17%
mallm/discussion_paradigms/relay.py                            22      9      2      1    58%
mallm/discussion_paradigms/report.py                           26     13      4      1    47%
mallm/evaluation/__init__.py                                    0      0      0      0   100%
mallm/evaluation/evaluator.py                                 225    225    124      0     0%
mallm/evaluation/metrics/__init__.py                            0      0      0      0   100%
mallm/evaluation/metrics/bertscore.py                           9      9      0      0     0%
mallm/evaluation/metrics/bleu.py                                9      9      0      0     0%
mallm/evaluation/metrics/ifeval.py                             90     90     18      0     0%
mallm/evaluation/metrics/meteor.py                             20     20      2      0     0%
mallm/evaluation/metrics/metric.py                             10     10      0      0     0%
mallm/evaluation/metrics/qa.py                                 52     52     14      0     0%
mallm/evaluation/metrics/rouge.py                              10     10      0      0     0%
mallm/evaluation/plotting/__init__.py                           0      0      0      0   100%
mallm/evaluation/plotting/plots.py                            314    314    104      0     0%
mallm/models/Chat.py                                          132     99     52      0    18%
mallm/models/MockOpenAI.py                                     76     76     32      0     0%
mallm/models/__init__.py                                        2      0      0      0   100%
mallm/models/discussion/CriticalResponseGenerator.py           44     30     12      0    25%
mallm/models/discussion/FreeTextResponseGenerator.py           63     41     14      0    29%
mallm/models/discussion/ReasoningResponseGenerator.py          46     29     10      0    30%
mallm/models/discussion/ResponseGenerator.py                  151     96     40      1    29%
mallm/models/discussion/SimpleResponseGenerator.py             55     37     14      0    26%
mallm/models/discussion/SplitFreeTextResponseGenerator.py      36     24      4      0    30%
mallm/models/discussion/__init__.py                             0      0      0      0   100%
mallm/models/personas/ExpertGenerator.py                       31     21      8      0    26%
mallm/models/personas/IPIPPersonaGenerator.py                  49     40     20      0    13%
mallm/models/personas/InformedGenerator.py                     17      8      4      0    43%
mallm/models/personas/MockGenerator.py                          9      0      0      0   100%
mallm/models/personas/NoPersonaGenerator.py                    11      2      0      0    82%
mallm/models/personas/PersonaGenerator.py                       9      1      0      0    89%
mallm/models/personas/__init__.py                               0      0      0      0   100%
mallm/scheduler.py                                            343    343     72      0     0%
mallm/scripts/__init__.py                                       0      0      0      0   100%
mallm/scripts/batch_mallm.py                                  106    106     24      0     0%
mallm/utils/CustomFormatter.py                                 10     10      0      0     0%
mallm/utils/__init__.py                                         0      0      0      0   100%
mallm/utils/config.py                                         101     45     32      1    43%
mallm/utils/dicts.py                                           30      0      0      0   100%
mallm/utils/enums.py                                           10      0      0      0   100%
mallm/utils/evaluation/__init__.py                              0      0      0      0   100%
mallm/utils/evaluation/instructions.py                        698    698    144      0     0%
mallm/utils/evaluation/instructions_registry.py                19     19      4      0     0%
mallm/utils/evaluation/instructions_util.py                    61     61     12      0     0%
mallm/utils/functions.py                                       12     12      6      0     0%
mallm/utils/task_instructions.py                                1      0      0      0   100%
mallm/utils/types.py                                           92     17     14      0    71%
mallm/utils/utils.py                                           35     35      0      0     0%
---------------------------------------------------------------------------------------------
TOTAL                                                        4185   3314   1152     29    18%

- annotate the in_range callback of _parse_trailing_digit_block (no-untyped-def) - drop the isinstance coercion in parse_vote_from_last_line: the argument is typed str, so mypy (warn_unreachable) flagged the branch as unreachable

jonas-becker added 2 commits October 10, 2026 11:29

informed agents voting update

e0cbe69

Merge branch 'informed_personas' of https://github.com/Multi-Agent-LL…

9a1bf55

…Ms/mallm into informed_personas

jonas-becker self-assigned this Oct 10, 2026

Fix mypy errors in simple_voting vote parsing

8934d27

- annotate the in_range callback of _parse_trailing_digit_block (no-untyped-def) - drop the isinstance coercion in parse_vote_from_last_line: the argument is typed str, so mypy (warn_unreachable) flagged the branch as unreachable

jonas-becker merged commit eeec9f5 into main Oct 10, 2026
15 of 16 checks passed

Navigation Menu

Repository navigation

Informed personas - #156

Informed personas#156
jonas-becker merged 3 commits into
mainfrom
informed_personas

jonas-becker commented Oct 10, 2026

Uh oh!

github-actions Bot commented Oct 10, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

jonas-becker commented Oct 10, 2026

Uh oh!

github-actions Bot commented Oct 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Coverage Report

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

github-actions Bot commented Oct 10, 2026 •

edited

Loading