Keep all snippets tokenized v1 with many strings [1015255]

16
LINES

< > BotCompany Repo | #1015255 // Keep all snippets tokenized v1 with many strings

JavaX source code (desktop) [tags: use-pretranspiled] - run with: x30.jar

Download Jar. Uses 3874K of libraries. Click here for Pure Java version (11458L/80K).

!7

static LL<S> allTokens;

p-experiment {
  restartWith1GBHeap();
  loadSnippetsDBForAnalysis();
  print("Tokenizing.");
  allTokens = new L;
  time {
    for (CSnippet s)
      if (nempty(s.text))
        allTokens.add(javaTok(s.text()));
  }
  print(n2(totalLength(allTokens)) + " tokens");
}

Author comment

Began life as a copy of #1015242

download show line numbers debug dex old transpilations

Travelled to 13 computer(s): aoiabmzegqzx, bhatertpkbcr, cbybwowwnfue, cfunsshuasjs, gwrvuhgaqvyk, ishqpsrjomds, lpdgvwnxivlt, mqqgnosmbjvj, pyentgdyhuwx, pzhvpgtvlbxg, tslmcundralx, tvejysmllsmz, vouqrxazstgt

No comments. add comment

Snippet ID:	#1015255
Snippet name:	Keep all snippets tokenized v1 with many strings
Eternal ID of this version:	#1015255/7
Text MD5:	3bc9a0bad107ed53eae871f5a531f4bd
Transpilation MD5:	86a40cb9364abd374a374a36ccd17d2c
Author:	stefan
Category:	javax
Type:	JavaX source code (desktop)
Public (visible to everyone):	Yes
Archived (hidden from active list):	No
Created/modified:	2018-05-11 03:33:47
Source code size:	311 bytes / 16 lines
Pitched / IR pitched:	No / No
Views / Downloads:	415 / 1000
Version history:	6 change(s)
Referenced in:	#1015256 - Keep all snippets tokenized [smart version with string sharing] #3000526 - Smart Bot's answer to: !fresh latestPrograms()