Try loading complete Simple Wikipedia [WORKS with -Xmx2g] [1008009]

< > BotCompany Repo | #1008009 // Try loading complete Simple Wikipedia [WORKS with -Xmx2g]

JavaX source code [tags: archive use-pretranspiled] - run with: x30.jar

!7

static int expectedSize = 571162253;
static byte[] bytes;

p {
  File f = getProgramFile("latest/simplewiki-latest-pages-articles.xml.bz2");
  if (fileSize(f) == 0)
    saveBinaryFile(f, loadBinaryPage(
"https://dumps.wikimedia.org/simplewiki/latest/simplewiki-latest-pages-articles.xml.bz2"));
  print("Wikipedia downloaded. Got " + fileSize(f) + " bytes.");
  print("Unpacking...");
  time2 {
    bytes = streamToBytes(bunzip2stream(f), expectedSize+10);
  }
  print("Unpacked to " + l(bytes) + " bytes.");
}

Travelled to 3 computer(s): cfunsshuasjs, mqqgnosmbjvj, tvejysmllsmz

Snippet ID:

#1008009

Snippet name:

Try loading complete Simple Wikipedia [WORKS with -Xmx2g]

Eternal ID of this version:

#1008009/7

Text MD5:

0472f9aded5ed611eb806f94007b599d

Transpilation MD5:

36c2d7690fcc3b8618f977c3bd65946f

Author:

stefan

Category:

javax / a.i. / networking

Type:

JavaX source code

Public (visible to everyone):

Yes

Archived (hidden from active list):

Yes

Created/modified:

2017-04-20 17:47:47

Source code size:

530 bytes / 17 lines

Pitched / IR pitched:

No / No

Views / Downloads:

779 / 1356

Version history:

6 change(s)

Referenced in:

[show references]

1	!7
2
3	static int expectedSize = 571162253;
4	static byte[] bytes;
5
6	p {
7	File f = getProgramFile("latest/simplewiki-latest-pages-articles.xml.bz2");
8	if (fileSize(f) == 0)
9	saveBinaryFile(f, loadBinaryPage(
10	"https://dumps.wikimedia.org/simplewiki/latest/simplewiki-latest-pages-articles.xml.bz2"));
11	print("Wikipedia downloaded. Got " + fileSize(f) + " bytes.");
12	print("Unpacking...");
13	time2 {
14	bytes = streamToBytes(bunzip2stream(f), expectedSize+10);
15	}
16	print("Unpacked to " + l(bytes) + " bytes.");
17	}