greedySplitIntoWordsCI_withChoices [dev.] [1028149]

< > BotCompany Repo | #1028149 // greedySplitIntoWordsCI_withChoices [dev.]

JavaX fragment (include)

static WithChoices<LS> greedySplitIntoWordsCI_withChoices(S s, Cl<S> words) {
  TreeSet<S> wordsSet = asCISet(words);
  int i = 0, last = 0;
  new LS out;
  while (i < l(s)) {
    int longest = l(longestPrefixInCISet(substring(s, i), wordsSet));
    for (int j = l(s); j > i; j--)
      if (contains(wordsSet, substring(s, i, j))) {
        S word = prefixesInCISet(, wordsSet);
    if (nempty(word)) {
      addIfNempty(out, substring(s, last, i));
      out.add(substring(s, i, i+l(word));
      last = i = i+l(word);
    } else ++i;
  }
  addIfNempty(out, substring(s, last, i));
  ret out;
}

Author comment

Began life as a copy of #1028147

Travelled to 7 computer(s): bhatertpkbcr, mqqgnosmbjvj, pyentgdyhuwx, pzhvpgtvlbxg, tvejysmllsmz, vouqrxazstgt, xrpafgyirdlv

Snippet ID:

#1028149

Snippet name:

greedySplitIntoWordsCI_withChoices [dev.]

Eternal ID of this version:

#1028149/1

Text MD5:

e9e13080f56c1700c4766d807c17a270

Author:

stefan

Category:

javax / stefan's os / nlp

Type:

JavaX fragment (include)

Public (visible to everyone):

Yes

Archived (hidden from active list):

Created/modified:

2020-05-23 16:42:44

Source code size:

612 bytes / 18 lines

Pitched / IR pitched:

No / No

Views / Downloads:

476 / 455

Referenced in:

[show references]

1	static WithChoices<LS> greedySplitIntoWordsCI_withChoices(S s, Cl<S> words) {
2	TreeSet<S> wordsSet = asCISet(words);
3	int i = 0, last = 0;
4	new LS out;
5	while (i < l(s)) {
6	int longest = l(longestPrefixInCISet(substring(s, i), wordsSet));
7	for (int j = l(s); j > i; j--)
8	if (contains(wordsSet, substring(s, i, j))) {
9	S word = prefixesInCISet(, wordsSet);
10	if (nempty(word)) {
11	addIfNempty(out, substring(s, last, i));
12	out.add(substring(s, i, i+l(word));
13	last = i = i+l(word);
14	} else ++i;
15	}
16	addIfNempty(out, substring(s, last, i));
17	ret out;
18	}