Skip to content

GitLab

  • Menu
Projects Groups Snippets
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in / Register
  • F FEDOT
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 87
    • Issues 87
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 1
    • Merge requests 1
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Packages & Registries
    • Packages & Registries
    • Package Registry
    • Container Registry
    • Infrastructure Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • ITMO-NSS-team
  • FEDOT
  • Merge requests
  • !663

Merged
Created Apr 29, 2022 by Elizaveta Lutsenko@LizLutsenkoOwner

Adaptation of API for multimodal data

  • Overview 130
  • Commits 22
  • Changes 31

Created by: andreygetmanov

Global purpose of PR - to make Fedot API work with multimodal data

Changes:

  • now multimodal datasets can be run via Fedot API as easy as unimodal datasets
  • now initial pipeline is based on the type of data (for example, text data always precedes a vectorizing node)
  • slightly changed the logics of operation filter. Now operations are chosen not only by task but by data type too (each data source will have its own operations list in next PRs)
  • MultiModalStrategy now works more effectively and stable
  • AssumptionsBuilder now supports multimodal data and creates subbuilder for each data source
  • added pretrained embeddings as vectorization models. The type of model can be chosen automatically during pipeline tuning
  • other parameters of text models now are tunable too
  • added various tests on new functionality
  • added new example based on text+table dataset
  • deleted deprecated imdb case
  • fixed issue Fix composer and tuner work in the multimodal case #630 (closed)
  • fixed issue Adapt multimodal example to run by API #626 (closed)
  • fixed issue Fix CNN work in the multimodal case #627 (closed)
Assignee
Assign to
Reviewer
Request review from
Time tracking
Source branch: multimodal_API