< > BotCompany Repo | #1028842 // pwt_fromTokenization

JavaX fragment (include) [tags: use-pretranspiled]

Libraryless. Click here for Pure Java version (2647L/17K).

static L<ParsedWithTokens<S>> pwt_fromTokenization(LS tok) {
  new L<ParsedWithTokens<S>> out;
  for i over tok: {
    S t = tok.get(i);
    // slightly abusing the spec of ParsedWithTokens by pointing to only 1 token (C or N)
    out.add(ParsedWithTokens(t, tok, i, i+1));
  }
  ret out;
}

download  show line numbers  debug dex  old transpilations   

Travelled to 7 computer(s): bhatertpkbcr, mqqgnosmbjvj, pyentgdyhuwx, pzhvpgtvlbxg, tvejysmllsmz, vouqrxazstgt, xrpafgyirdlv

No comments. add comment