Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
P parabix-devel
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 9
    • Issues 9
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 2
    • Merge requests 2
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • cameron
  • parabix-devel
  • Issues
  • #36

Closed
Open
Created Jan 02, 2023 by cameron@cameronMaintainer

Run-time creation of Repeating Stream Sets

Repeating stream sets have made an important contribution to csv2json functionality and performance. In particular, the repeating streamset concept has eliminated the use of bitwise logic to compile the fixed field name template into the csv2json pipeline. As a consequence, the current csv2json has dramatically improved performance for csv files with very large numbers of columns.

Further progress in eliminating JIT compile-time dependencies on CSV file type (following the general concern of issue #35) can be achieved by a capability for creating repeating stream sets at run-time rather than JIT compile-time.

The simplest approach is to create a method that converts a fixed-length input stream set into a repeating stream set of the same shape.

To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information
Assignee
Assign to
None
Milestone
None
Assign milestone
Time tracking