Not logged in.  Login/Logout/Register | List snippets | | Create snippet | Upload image | Upload data

17
LINES

< > BotCompany Repo | #1008009 // Try loading complete Simple Wikipedia [WORKS with -Xmx2g]

JavaX source code [tags: archive use-pretranspiled] - run with: x30.jar

Uses 865K of libraries. Click here for Pure Java version (1266L/9K/30K).

!7

static int expectedSize = 571162253;
static byte[] bytes;

p {
  File f = getProgramFile("latest/simplewiki-latest-pages-articles.xml.bz2");
  if (fileSize(f) == 0)
    saveBinaryFile(f, loadBinaryPage(
"https://dumps.wikimedia.org/simplewiki/latest/simplewiki-latest-pages-articles.xml.bz2"));
  print("Wikipedia downloaded. Got " + fileSize(f) + " bytes.");
  print("Unpacking...");
  time2 {
    bytes = streamToBytes(bunzip2stream(f), expectedSize+10);
  }
  print("Unpacked to " + l(bytes) + " bytes.");
}

download  show line numbers  debug dex  old transpilations   

Travelled to 3 computer(s): cfunsshuasjs, mqqgnosmbjvj, tvejysmllsmz

No comments. add comment

Snippet ID: #1008009
Snippet name: Try loading complete Simple Wikipedia [WORKS with -Xmx2g]
Eternal ID of this version: #1008009/7
Text MD5: 0472f9aded5ed611eb806f94007b599d
Transpilation MD5: 36c2d7690fcc3b8618f977c3bd65946f
Author: stefan
Category: javax / a.i. / networking
Type: JavaX source code
Public (visible to everyone): Yes
Archived (hidden from active list): Yes
Created/modified: 2017-04-20 17:47:47
Source code size: 530 bytes / 17 lines
Pitched / IR pitched: No / No
Views / Downloads: 594 / 1141
Version history: 6 change(s)
Referenced in: #1008013 - downloadSimpleWikipedia
#1008019 - unpackSimpleWikipedia
#1014166 - indexedSimpleWikipedia_fast - returns "magic" map; makes/uses .index file