Not logged in.  Login/Logout/Register | List snippets | | Create snippet | Upload image | Upload data

16
LINES

< > BotCompany Repo | #1015255 // Keep all snippets tokenized v1 with many strings

JavaX source code (desktop) [tags: use-pretranspiled] - run with: x30.jar

Download Jar. Uses 3874K of libraries. Click here for Pure Java version (11458L/80K).

1  
!7

2  


3  
static LL<S> allTokens;



4  


5  
p-experiment {



6  
  restartWith1GBHeap();



7  
  loadSnippetsDBForAnalysis();



8  
  print("Tokenizing.");



9  
  allTokens = new L;



10  
  time {



11  
    for (CSnippet s)



12  
      if (nempty(s.text))



13  
        allTokens.add(javaTok(s.text()));



14  
  }



15  
  print(n2(totalLength(allTokens)) + " tokens");



16  
}



        
Author comment

    
Began life as a copy of #1015242

    
download  show line numbers  debug dex  old transpilations   
Travelled to 13 computer(s): aoiabmzegqzx, bhatertpkbcr, cbybwowwnfue, cfunsshuasjs, gwrvuhgaqvyk, ishqpsrjomds, lpdgvwnxivlt, mqqgnosmbjvj, pyentgdyhuwx, pzhvpgtvlbxg, tslmcundralx, tvejysmllsmz, vouqrxazstgt


No comments. add comment
      
      
  

  

    Snippet ID:
    #1015255
  

  

    Snippet name:
    Keep all snippets tokenized v1 with many strings
  

    

    Eternal ID of this version:
    #1015255/7
  

  

    Text MD5:
    3bc9a0bad107ed53eae871f5a531f4bd
  

    

    Transpilation MD5:
    86a40cb9364abd374a374a36ccd17d2c
  

    

    Author:
    stefan
  

  

    Category:
    javax
  

  

    Type:
    JavaX source code (desktop)
  

        

    Public (visible to everyone):
    Yes
  

  

    Archived (hidden from active list):
    No
  

  

    Created/modified:
      2018-05-11 03:33:47
  

  

    Source code size:
    311 bytes / 16 lines
  

  

    Pitched / IR pitched:
    No / No
  

    

    Views / Downloads:
    416 / 1004
  

      

    Version history:
    6 change(s)
  

    

    Referenced in:
[show references]