Input Tokenizer v1 [OK] [1022887]

22
LINES

< > BotCompany Repo | #1022887 // Input Tokenizer v1 [OK]

JavaX source code (Dynamic Module) [tags: use-pretranspiled] - run with: Stefan's OS

Uses 911K of libraries. Click here for Pure Java version (10296L/56K).

!7

set flag DynModule.

sclass Entry {
  S function;
  S tokenized;
}

cmodule InputTokenizer > DynBigInputAndList<Entry> {
  transient LS functions = ll(
    f javaTok,
    f javaTokWithBrackets,
    f javaTokNPunct,
    f javaTokWithAngleBrackets);
  
  void makeList_impl() {
    S text = this.text;
    setList(map_pcall(functions, function ->
      nu Entry(+function, tokenized := sfu(callAndMake(function, text)))));
  }
}

download show line numbers debug dex old transpilations

Travelled to 7 computer(s): bhatertpkbcr, cfunsshuasjs, mqqgnosmbjvj, pyentgdyhuwx, pzhvpgtvlbxg, tvejysmllsmz, vouqrxazstgt

No comments. add comment

Snippet ID:	#1022887
Snippet name:	Input Tokenizer v1 [OK]
Eternal ID of this version:	#1022887/11
Text MD5:	a7e3dac6334ca0470143e043424fe7c0
Transpilation MD5:	713816467e4683ba4332ff8deb2b8601
Author:	stefan
Category:	javax / stefan's os / a.i.
Type:	JavaX source code (Dynamic Module)
Public (visible to everyone):	Yes
Archived (hidden from active list):	No
Created/modified:	2019-04-12 19:13:41
Source code size:	451 bytes / 22 lines
Pitched / IR pitched:	No / No
Views / Downloads:	282 / 491
Version history:	10 change(s)
Referenced in:	[show references]

1	!7
2
3	set flag DynModule.
4
5	sclass Entry {
6	S function;
7	S tokenized;
8	}
9
10	cmodule InputTokenizer > DynBigInputAndList<Entry> {
11	transient LS functions = ll(
12	f javaTok,
13	f javaTokWithBrackets,
14	f javaTokNPunct,
15	f javaTokWithAngleBrackets);
16
17	void makeList_impl() {
18	S text = this.text;
19	setList(map_pcall(functions, function ->
20	nu Entry(+function, tokenized := sfu(callAndMake(function, text)))));
21	}
22	}