Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: Dev-Vijay-Mate/openml-python
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: openml/openml-python
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 16 commits
  • 82 files changed
  • 14 contributors

Commits on Mar 6, 2026

  1. [MNT] Update setup list test assertion (openml#1652)

    Fixes openml#1645
    
    ```
    import openml
    
    openml.config.server = "https://www.openml.org/api/v1/xml"
    setups = openml.setups.list_setups(flow=5873)
    ```
    <img width="334" height="201" alt="Screenshot 2026-02-18 at 7 12 32 PM"
    src="iframe.php?url=https%3A%2F%2Fgithub.com%2F%3Ca+href%3D"https://github.com/user-attachments/assets/9efaca17-c3f4-4c41-aac9-3809062e9ced">https://github.com/user-attachments/assets/9efaca17-c3f4-4c41-aac9-3809062e9ced"
    />
    
    Current number of setups is 2. 
    
    > 1. For now, please keep using the production server for this test as
    the test server is not guaranteed to have setups (yet)
    > 2. Make the assertion based on a minimum. It is possible that people
    upload more runs for the flow (and consequently, more setups). It is
    also possible they delete them, but not so likely. So I would check a
    lower bound that is lower than what is currently on the production
    server.
    
    cc @geetu040 @PGijsbers so should we use the lower bound as 1?  
    ```
    assert len(setups) >= 1
    ```
    omkar-334 authored Mar 6, 2026
    Configuration menu
    Copy the full SHA
    e95675a View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2026

  1. [MNT] Dockerized tests for CI runs using localhost (openml#1629)

    #### Metadata
    * Reference Issue: fixes openml#1614, stacks on openml#1630
    * New Tests Added: No
    * Documentation Updated: No
    
    
    #### Details 
    * What does this PR implement/fix? Explain your changes.
    This PR implements the setting up of the v1 and v2 test servers in CI
    using docker via `localhost`.
    
    ---------
    
    Co-authored-by: PGijsbers <p.gijsbers@tue.nl>
    Co-authored-by: Armaghan Shakir <raoarmaghanshakir040@gmail.com>
    3 people authored Mar 9, 2026
    Configuration menu
    Copy the full SHA
    8cc6429 View commit details
    Browse the repository at this point in the history

Commits on Mar 10, 2026

  1. [MNT] Update CI/CD local server deployment and dependency matrix (ope…

    …nml#1697)
    
    Originally started in openml#1629, this PR spins up the services within CI
    uses that as a local test server for the ubuntu-based tests, closing
    openml#1614.
    
    It also updates the test matrix to make sure included dependencies are
    only those that have a release on PyPI, and further restriction pandas
    3.x installs to only scikit-learn 1.7 and up. Older scikit-learn
    versions do not play well with scikit-learn 1.6 or below.
    
    Finally, it updates some tests to reflect the new test database image state.
    
    ---------
    
    Co-authored-by: Satvik Mishra <112589278+satvshr@users.noreply.github.com>
    Co-authored-by: Armaghan Shakir <raoarmaghanshakir040@gmail.com>
    3 people authored Mar 10, 2026
    Configuration menu
    Copy the full SHA
    25ba6f8 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2026

  1. [ENH] Improve Global Config Architecture (openml#1577)

    #### Metadata
    * Reference Issue: fixes openml#1564 
    * New Tests Added: No
    * Documentation Updated: No
    * Change Log Entry: Replaces global variables with an instance of a
    dataclass `OpenMLConfig`.
    
    
    #### Details 
    * What does this PR implement/fix? Explain your changes.
    * Mainly Introduces an `OpenMLConfig` dataclass and an
    `OpenMLConfigManager` class to accumulate all config functions and
    varialbles into one class, and a single module-level instance `_config`
    in `openml.config`.
      * Reads/parses configuration defaults from `OpenMLConfig`.
    * Adds `__getattr__` so attribute reads on openml.config forward to the
    dataclass (preserving read compatibility).
    * Changes `openml/__init__.py` to route to the instance of
    `OpenMLConfigManager` when `openml.config` is called.
    * Moved `ConfigurationForExamples` inside `OpenMLConfigManager` to
    preserve API.
      
    * Why is this change necessary? What is the problem it solves?
      * consolidates defaults and runtime state into one place,
      * simplifies consistent parsing and writing of the config file,
      * removes the use of global variables.
    
    ---------
    
    Co-authored-by: Franz Király <fkiraly@gcos.ai>
    Co-authored-by: Armaghan Shakir <raoarmaghanshakir040@gmail.com>
    3 people authored Mar 12, 2026
    Configuration menu
    Copy the full SHA
    8a5532f View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2026

  1. [ENH] V1 → V2 API Migration - core structure (openml#1576)

    Towards openml#1575
    
    This PR sets up the core folder and file structure along with base
    scaffolding for the API v1 → v2 migration.
    
    It includes:
    
    * Skeleton for the HTTP client, backend, and API context
    * Abstract resource interfaces and versioned stubs (`*V1`, `*V2`)
    * Minimal wiring to allow future version switching and fallback support
    
    No functional endpoints are migrated yet. This PR establishes a stable
    foundation for subsequent migration and refactor work.
    
    ---------
    
    Co-authored-by: Satvik Mishra <112589278+satvshr@users.noreply.github.com>
    Co-authored-by: Franz Király <fkiraly@gcos.ai>
    Co-authored-by: Simon Blanke <simon.blanke@yahoo.com>
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    Co-authored-by: Matthias Feurer <lists@matthiasfeurer.de>
    Co-authored-by: Pieter Gijsbers <p.gijsbers@tue.nl>
    7 people authored Mar 23, 2026
    Configuration menu
    Copy the full SHA
    8185ccc View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2026

  1. [ENH] V1 → V2 API Migration - evaluations (openml#1606)

    Fixes openml#1623 
    Depends on openml#1576
    Related to openml#1575
    
    #### Details 
    This PR implements `Evaluations` resource, and refactor its existing
    functions
    
    ---------
    
    Co-authored-by: Satvik Mishra <112589278+satvshr@users.noreply.github.com>
    Co-authored-by: geetu040 <raoarmaghanshakir040@gmail.com>
    Co-authored-by: Franz Király <fkiraly@gcos.ai>
    Co-authored-by: Simon Blanke <simon.blanke@yahoo.com>
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    Co-authored-by: Matthias Feurer <lists@matthiasfeurer.de>
    Co-authored-by: Pieter Gijsbers <p.gijsbers@tue.nl>
    8 people authored Mar 24, 2026
    Configuration menu
    Copy the full SHA
    8ff14eb View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2026

  1. [ENH] V1 → V2 API Migration - evaluation measures (openml#1603)

    Fixes openml#1593
    Depends on openml#1576
    Related to openml#1575
    
    #### Details 
    This PR implements `EvaluationMeasures` resource, and refactor its
    existing functions
    
    ---------
    
    Co-authored-by: Satvik Mishra <112589278+satvshr@users.noreply.github.com>
    Co-authored-by: geetu040 <raoarmaghanshakir040@gmail.com>
    Co-authored-by: Franz Király <fkiraly@gcos.ai>
    Co-authored-by: Simon Blanke <simon.blanke@yahoo.com>
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    Co-authored-by: Matthias Feurer <lists@matthiasfeurer.de>
    Co-authored-by: Pieter Gijsbers <p.gijsbers@tue.nl>
    8 people authored Mar 25, 2026
    Configuration menu
    Copy the full SHA
    fe58eb0 View commit details
    Browse the repository at this point in the history
  2. [ENH] V1 → V2 API Migration - setups (openml#1619)

    Fixes openml#1625 
    Depends on openml#1576
    Related to openml#1575
    
    Details
    This PR implements `Setups` resource, and refactor its existing
    functions
    
    ---------
    
    Co-authored-by: Franz Király <fkiraly@gcos.ai>
    Co-authored-by: Satvik Mishra <112589278+satvshr@users.noreply.github.com>
    Co-authored-by: geetu040 <raoarmaghanshakir040@gmail.com>
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    Co-authored-by: Simon Blanke <simon.blanke@yahoo.com>
    Co-authored-by: Matthias Feurer <lists@matthiasfeurer.de>
    Co-authored-by: Pieter Gijsbers <p.gijsbers@tue.nl>
    8 people authored Mar 25, 2026
    Configuration menu
    Copy the full SHA
    ec3ed63 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2026

  1. [ENH] V1 → V2 API Migration - estimation procedures (openml#1604)

    Fixes openml#1622
    Depends on openml#1576 
    Related to: openml#1575 
    
    #### Details
    This PR implements `EstimationProcedures` resource, and refactor its
    existing functions
    
    ---------
    
    Co-authored-by: Satvik Mishra <112589278+satvshr@users.noreply.github.com>
    Co-authored-by: geetu040 <raoarmaghanshakir040@gmail.com>
    Co-authored-by: Franz Király <fkiraly@gcos.ai>
    Co-authored-by: Simon Blanke <simon.blanke@yahoo.com>
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    Co-authored-by: Matthias Feurer <lists@matthiasfeurer.de>
    Co-authored-by: Pieter Gijsbers <p.gijsbers@tue.nl>
    8 people authored Mar 26, 2026
    Configuration menu
    Copy the full SHA
    e653ef6 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2026

  1. [ENH] V1 → V2 API Migration - studies (openml#1610)

    #### Metadata
    * Reference Issue: openml#1594 (towards openml#1575)
    * New Tests Added: No
    * Documentation Updated: No
    
    #### Details 
    Stackend PR, Depends on openml#1576 
    
    This PR adds `Studies v2` migration.
    
    A question:
    Due to the pre commit hook i could not put 6 arguments in a function, so
    i had to workaround that with this instead:
    openml\_api\resources\studies.py (line 10-15)
    ```py
            limit = kwargs.get("limit")
            offset = kwargs.get("offset")
            status = kwargs.get("status")
            main_entity_type = kwargs.get("main_entity_type")
            uploader = kwargs.get("uploader")
            benchmark_suite = kwargs.get("benchmark_suite")
    ```
    
    I would like to confirm if this approach is correct or not. Raising a
    draft PR for now.
    
    ---------
    
    Signed-off-by: rohansen856 <rohansen856@gmail.com>
    Co-authored-by: Satvik Mishra <112589278+satvshr@users.noreply.github.com>
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    Co-authored-by: geetu040 <raoarmaghanshakir040@gmail.com>
    Co-authored-by: Franz Király <fkiraly@gcos.ai>
    Co-authored-by: Simon Blanke <simon.blanke@yahoo.com>
    Co-authored-by: Matthias Feurer <lists@matthiasfeurer.de>
    Co-authored-by: Pieter Gijsbers <p.gijsbers@tue.nl>
    8 people authored May 11, 2026
    Configuration menu
    Copy the full SHA
    c62bf51 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2026

  1. [DOC] Add usage examples to core function docstrings (Fixes openml#1538

    …) (openml#1689)
    
    # [DOC] Add usage examples to core function docstrings. Closes openml#1538
    
    #### Metadata
    - Reference Issue: Fixes openml#1538
    - New Tests Added: No
    - Documentation Updated: Yes
    - Change Log Entry: Add usage examples to core function docstrings
    
    #### Details
    
    This PR adds usage examples to selected public core functions in the
    project
    to improve developer experience and documentation clarity.
    
    The following functions were updated with example usage sections:
    - get_dataset()
    - get_datasets()
    - get_task()
    - run_model_on_task()
    - get_suite()
    - get_study()
    - create_study()
    
    Why this change is necessary:
    Examples in docstrings help users understand how to use the functions
    directly
    from IDE hover tooltips and improve auto-generated documentation.
    
    Reproduction:
    No bug reproduction is required. This is a documentation enhancement.
    
    Additional Notes:
    Only docstrings were modified. No functional code changes were made.
    
    ---------
    
    Co-authored-by: Abhishek <abhishekup082gmail.com@Abhisheks-MacBook-Air.local>
    Co-authored-by: Franz Király <fkiraly@gcos.ai>
    Co-authored-by: Pieter Gijsbers <p.gijsbers@tue.nl>
    4 people authored May 21, 2026
    Configuration menu
    Copy the full SHA
    9666622 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2026

  1. Configuration menu
    Copy the full SHA
    1f6fed4 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2026

  1. [ENH] Top-Level Aliases for get and list Operations (openml#1551)

    for get_* and list_* operations 
    ---------
    
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
    Co-authored-by: Pieter Gijsbers <p.gijsbers@tue.nl>
    Co-authored-by: Armaghan Shakir <raoarmaghanshakir040@gmail.com>
    5 people authored May 26, 2026
    Configuration menu
    Copy the full SHA
    dc1b22a View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2026

  1. [ENH] Reduce complexity of run_flow_on_task func (openml#1596)

    ## Summary
    
    This PR refactors `run_flow_on_task`, which had grown to ~160 lines with
    high cyclomatic complexity, by extracting small helper functions with
    clear, single responsibilities. The main function is now a readable
    orchestrator with clearly defined steps.
    
    ---
    
    ## Changes
    
    ### Extracted helper functions
    
    * **`_validate_flow_and_task_inputs`**
      Handles input validation and backward-compatible argument handling
    
    * **`_sync_flow_with_server`**
      Synchronizes the flow with the server and checks for duplicate runs
    
    * **`_prepare_run_environment`**
      Prepares environment information and run tags
    
    * **`_create_run_from_results`**
      Builds the `OpenMLRun` object from execution results
    
    ### Internal structure improvements
    
    * Introduced a `_RunResults` `NamedTuple` to bundle execution outputs
    (`data_content`, `trace`, `evaluations`) and reduce long parameter lists
    
    ---
    
    ## Type Safety Improvements
    
    * Replaced `assert` statements with explicit `ValueError` / `TypeError`
    exceptions
    * Added type guards before accessing attributes that may be `None`
    * Made boolean parameters keyword-only where appropriate
    
    ---
    
    Fixes openml#1580
    
    ---------
    
    Signed-off-by: Omswastik-11 <omswastikpanda11@gmail.com>
    Co-authored-by: Franz Király <fkiraly@gcos.ai>
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    Co-authored-by: Armaghan Shakir <raoarmaghanshakir040@gmail.com>
    4 people authored Jun 3, 2026
    Configuration menu
    Copy the full SHA
    3486b2a View commit details
    Browse the repository at this point in the history
  2. [ENH] V1 -> V2 Migration : Runs (openml#1616)

    fixes openml#1624
    
    ---------
    
    Signed-off-by: Omswastik-11 <omswastikpanda11@gmail.com>
    Co-authored-by: Simon Blanke <simon.blanke@yahoo.com>
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    Co-authored-by: geetu040 <raoarmaghanshakir040@gmail.com>
    Co-authored-by: Satvik Mishra <112589278+satvshr@users.noreply.github.com>
    Co-authored-by: Matthias Feurer <lists@matthiasfeurer.de>
    Co-authored-by: Pieter Gijsbers <p.gijsbers@tue.nl>
    Co-authored-by: Franz Király <fkiraly@gcos.ai>
    Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
    9 people authored Jun 3, 2026
    Configuration menu
    Copy the full SHA
    c631b28 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2026

  1. [ENH] V1 -> V2 Migration - Flows (module) (openml#1609)

    Fixes openml#1601 
    
    ---------
    
    Signed-off-by: Omswastik-11 <omswastikpanda11@gmail.com>
    Co-authored-by: geetu040 <raoarmaghanshakir040@gmail.com>
    Co-authored-by: Simon Blanke <simon.blanke@yahoo.com>
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    Co-authored-by: Satvik Mishra <112589278+satvshr@users.noreply.github.com>
    Co-authored-by: Matthias Feurer <lists@matthiasfeurer.de>
    Co-authored-by: Pieter Gijsbers <p.gijsbers@tue.nl>
    Co-authored-by: Franz Király <fkiraly@gcos.ai>
    Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
    9 people authored Jun 4, 2026
    Configuration menu
    Copy the full SHA
    fabbc28 View commit details
    Browse the repository at this point in the history
Loading