Skip to content
GitLab
Projects
Groups
Snippets
Help
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Open sidebar
yzong
parabix-devel
Commits
b251febc
Commit
b251febc
authored
6 years ago
by
Rob Cameron
Browse files
Options
Download
Email Patches
Plain Diff
Applying deletion to Unicode LB stream
parent
013d7017
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
1 deletion
+8
-1
icgrep/grep/grep_engine.cpp
icgrep/grep/grep_engine.cpp
+8
-1
No files found.
icgrep/grep/grep_engine.cpp
View file @
b251febc
...
...
@@ -346,7 +346,7 @@ std::pair<StreamSet *, StreamSet *> GrepEngine::grepPipeline(const std::unique_p
mGrepDriver
.
LinkFunction
(
LB_nullK
,
"signal_dispatcher"
,
kernel
::
signal_dispatcher
);
}
else
{
options
->
addExternal
(
"UTF8_index"
,
U8index
);
if
(
mGrepRecordBreak
==
GrepRecordBreakKind
::
Unicode
)
{
if
(
mGrepRecordBreak
==
GrepRecordBreakKind
::
Unicode
&&
!
UnicodeIndexing
)
{
options
->
addExternal
(
"UTF8_LB"
,
LineBreakStream
);
}
if
(
CC_Multiplexing
)
{
...
...
@@ -367,6 +367,13 @@ std::pair<StreamSet *, StreamSet *> GrepEngine::grepPipeline(const std::unique_p
const
unsigned
compressFieldWidth
=
sizeof
(
size_t
)
*
8
;
P
->
CreateKernelCall
<
FieldCompressKernel
>
(
compressFieldWidth
,
CharClasses
,
U8index
,
fieldCompressedCCs
);
P
->
CreateKernelCall
<
StreamCompressKernel
>
(
fieldCompressedCCs
,
U8index
,
compressedCCs
,
compressFieldWidth
);
StreamSet
*
fieldCompressedLB
=
P
->
CreateStreamSet
();
StreamSet
*
compressedLB
=
P
->
CreateStreamSet
();
P
->
CreateKernelCall
<
FieldCompressKernel
>
(
compressFieldWidth
,
LineBreakStream
,
U8index
,
fieldCompressedLB
);
P
->
CreateKernelCall
<
StreamCompressKernel
>
(
fieldCompressedLB
,
U8index
,
compressedLB
,
compressFieldWidth
);
if
(
mGrepRecordBreak
==
GrepRecordBreakKind
::
Unicode
)
{
options
->
addExternal
(
"UTF8_LB"
,
compressedLB
);
}
options
->
setIndexingAlphabet
(
&
cc
::
Unicode
);
}
}
...
...
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment