Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
P parabix-devel
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 9
    • Issues 9
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 2
    • Merge requests 2
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • cameron
  • parabix-devel
  • Wiki
  • KernelLibrary

Last edited by cameron May 06, 2024
Page history
This is an old version of this page. You can view the most recent version or browse the history.

KernelLibrary

Kernel Library

The Parabix Kernel Library has a number of useful kernels for building applications. Look for information in the include/kernels directory.

I/O Kernels: Sources and Sinks

Source kernels are kernels that provide the input data streams for processing by other kernels. There are source kernels for obtaining input streams from the operating systems (files or devices) as well as from memory buffers.

ReadSourceKernel produces a data stream by using the operating system read call to populate the input stream. Normally, the stream set produceed is a ```1xi8`` stream set, i.e., a stream set consisting of a single stream of 8-bit values (bytes). Typical usage:

StreamSet * const ByteStream = P->CreateStreamSet(1, 8);
P->CreateKernelCall<ReadSourceKernel>(fileDescriptor, ByteStream);

Here P is a program or pipeline builder, and fileDescriptor is scalar integer for an open file or device. In addition to byte streams, read source kernels may produce streams of 16-, 32, or 64-bit values.

MMapSourceKernel is a substitution for ReadSourceKernel that may be used to populate an input stream using the operating system mmap facility on Posix-based systems. Its usage is restricted to input from open file descriptors that correspond to plain files, it may not be used with devices or with standard input.

FDSourceKernel is a somewhat more flexible input kernel that allows the choice of using read or mmap at run-time. It takes one additional input parameter, a boolean scalar value identifying whether to use mmap if possible. If this scalar is given the value 1 (true), then mmap will be used for ordinary files, while read will be used for devices or standard input.

MemorySourceKernel is a kernel that produces a stream set from a memory buffer. Its parameters are a scalar pointer to the buffer, and a scalar length of the buffer.

Transposition

Stream Utilities

Clone repository
  • Bracket Matching
  • CSV Validation
  • CSVediting
  • CSVparsing
  • Character Code Compilers
  • KernelLibrary
  • Pablo
  • ParabixTransform
  • Parallel Deletion
  • Parallel Hashing
  • Performance Testing Script
  • Shuffle Pattern Library
  • StaticCCC
  • String Insertion
  • UCD: Unicode Property Database and Compilers
View All Pages