Not logged in.  Login/Logout/Register | List snippets | | Create snippet | Upload image | Upload data

19
LINES

< > BotCompany Repo | #1002301 // Tokenizer Bot

JavaX source code [tags: use-pretranspiled] - run with: x30.jar

Libraryless. Click here for Pure Java version (1129L/7K/24K).

1  
!752

2  


3  
p {



4  
  //makeBot("Tokenizer Bot");



5  
}



6  


7  
answer {



8  
  if "javatok *"



9  
    ret structure(javaTok(m.unq(0)));



10  


11  
  if "pythontojavatok *"



12  
    ret structure(pythonToJavaTok(m.unq(0)));



13  
    



14  
  s = s.trim();



15  
  if (swic(s, "snltok ")) {



16  
    s = dropPrefixIgnoreCase("snltok ", s);



17  
    ret structure(codeTokens(snlTok(s)));



18  
  }



19  
}



      
download  show line numbers  debug dex  old transpilations   
Travelled to 15 computer(s): aoiabmzegqzx, bhatertpkbcr, cbybwowwnfue, cfunsshuasjs, gwrvuhgaqvyk, ishqpsrjomds, lpdgvwnxivlt, mqqgnosmbjvj, onxytkatvevr, pyentgdyhuwx, pzhvpgtvlbxg, teubizvjbppd, tslmcundralx, tvejysmllsmz, vouqrxazstgt


No comments. add comment
      
      
  

  

    Snippet ID:
    #1002301
  

  

    Snippet name:
    Tokenizer Bot
  

    

    Eternal ID of this version:
    #1002301/1
  

  

    Text MD5:
    69869e11876bbad49f361ec04540297a
  

    

    Transpilation MD5:
    bc02ffb8963abd3d9f86c9b2dd7a240b
  

    

    Author:
    stefan
  

  

    Category:
    javax
  

  

    Type:
    JavaX source code
  

        

    Public (visible to everyone):
    Yes
  

  

    Archived (hidden from active list):
    No
  

  

    Created/modified:
      2016-03-12 17:51:40
  

  

    Source code size:
    337 bytes / 19 lines
  

  

    Pitched / IR pitched:
    No / No
  

    

    Views / Downloads:
    938 / 1889
  

      

    Referenced in:
[show references]