... | @@ -158,10 +158,7 @@ In this mask, all character positions to be deleted are marked with 0 bits. Ca |
... | @@ -158,10 +158,7 @@ In this mask, all character positions to be deleted are marked with 0 bits. Ca |
|
|
|
|
|
Given this mask, we need to apply FilterByMask to produce two streamsets:
|
|
Given this mask, we need to apply FilterByMask to produce two streamsets:
|
|
1. `FilteredBasisBits` is produced by filtering the eight basis bit streams.
|
|
1. `FilteredBasisBits` is produced by filtering the eight basis bit streams.
|
|
2. `FilteredMarks` is produced by filtering two streams produced from parsing.
|
|
2. `FilteredMarks` is produced by filtering two streams produced from parsing: (a) the positions of starts of each record, (b) the positions of the starts of each field, and (c) the positions of any characters that need to be escaped with `\` in the JSON output (escaped_quotes and embedded newlines).
|
|
a. The positions of starts of each record.
|
|
|
|
b. The positions of the starts of each field.
|
|
|
|
c. The positions of any characters that need to be escaped with `\` in the JSON output (escaped_quotes and embedded newlines).
|
|
|
|
|
|
|
|
### Expansion of Compressed Input
|
|
### Expansion of Compressed Input
|
|
|
|
|
... | | ... | |