Help - Search - Members - Calendar
Full Version: Gigantic, Monstrous Logfile, Unable To Handle
Achaea's Forums > Off-Topic > Tech Support
Mymyc
I have a nice ANSI coloured html logfile. The file is 1240 MB, how can I browse or copy/paste spars etc? How the hell can I open it and search in it? Every browser, notepad etc freeze when try to open. Waitin 15 minutes won't help at all.

The file was created with MushClient (append log).

wacko.gif

Help pwease!

I use WinXP/Ubuntu on the same machine. 2.6GHz Celeron, 512MB ram. 500 GB HDD.
dalavan
Try http://www.jujusoft.com/software/edit/index.html ?

Alternatively look over this page http://www.reddit.com/r/programming/commen...en_a_text_file/
Mymyc
QUOTE (dalavan @ Jul 27 2009, 04:50 PM) *


JujuEdit is fine, 1 sec to open the logfile, thanks. Unfortunatelly it won't show html files, so I see the html code as a textfile. Ok, I will find a html to color ANSI text converter and problem solved.
Saadya
Why do you have so little RAM?
Mymyc
QUOTE (Saadya @ Jul 27 2009, 05:06 PM) *
Why do you have so little RAM?


It is my old pc, nothing fancy. XP is fast.

No matter what is the max ram or how fast is a CPU, -ty text editors (like notepad) will nearly freeze your system if you try to open 500-1000 MB text. After you opened it, try to search a few words or a sentence, your pc will siht birx.
Saadya
Personally, I use editpad pro. But it costs money. I'm sure there are good open source text editors out there.
Mymyc
Update: JujuEdit siht birx when I try to search inside the file. Freezing, not responding.

I will use Midnight commander with the builtin viewer. Open the file relatively slowly (20-30 sec) but it stay fast and never freeze. It cut out the html tag garbage and show the log as text black on white. Also searching is extremely fast.
Penquin
QUOTE (Mymyc @ Jul 27 2009, 07:40 AM) *
I have a nice ANSI coloured html logfile. The file is 1240 MB, how can I browse or copy/paste spars etc? How the hell can I open it and search in it? Every browser, notepad etc freeze when try to open. Waitin 15 minutes won't help at all.

The file was created with MushClient (append log).

wacko.gif

Help pwease!

I use WinXP/Ubuntu on the same machine. 2.6GHz Celeron, 512MB ram. 500 GB HDD.



Inside Ubuntu

Open a terminal, browse to your LOGS directory, or wherever the file is.

CODE
split -b 524288 logfile.html logfile_SMALL-


That will split your large file into half MB files, named 'logfile_SMALL-' with alpha characters appended.

If you want the files larger, adjust the argument after -b accordingly.
Santar
QUOTE (Mymyc @ Jul 27 2009, 12:40 PM) *
I have a nice ANSI coloured html logfile. The file is 1240 MB, how can I browse or copy/paste spars etc? How the hell can I open it and search in it? Every browser, notepad etc freeze when try to open. Waitin 15 minutes won't help at all.

The file was created with MushClient (append log).

wacko.gif

Help pwease!

I use WinXP/Ubuntu on the same machine. 2.6GHz Celeron, 512MB ram. 500 GB HDD.



I don't know, I've never really been into Pokemon.
Sena
Why would you keep that many logs in a single, ridiculously huge file? That's your main problem.
berenene
QUOTE (Santar @ Jul 28 2009, 05:53 AM) *
QUOTE (Mymyc @ Jul 27 2009, 12:40 PM) *
I have a nice ANSI coloured html logfile. The file is 1240 MB, how can I browse or copy/paste spars etc? How the hell can I open it and search in it? Every browser, notepad etc freeze when try to open. Waitin 15 minutes won't help at all.

The file was created with MushClient (append log).

wacko.gif

Help pwease!

I use WinXP/Ubuntu on the same machine. 2.6GHz Celeron, 512MB ram. 500 GB HDD.



I don't know, I've never really been into Pokemon.

Trevize
huh.gif make different logs every day, at the least! It's not hard, in MUSH.
Mymyc
QUOTE (Trevize @ Jul 28 2009, 01:11 AM) *
huh.gif make different logs every day, at the least! It's not hard, in MUSH.


Problem solved. I've found a html to text converter program. After 5 minutes of grinding my 1.25 gig logfile was reborn in the flame and reincarnated into a 250 MB textfile!

I spliced up the my new baby into 50 MB chunks.

I will never let mushclient create another gigantic file. I will create separate logfiles. Every logfile will contain 7 IRL days of achaean stuff.
Jonathin
I just log everyday. If it's the same day, it appends. If it's a new day, it makes a new log.

Much easier to handle that way.
Soludra
QUOTE (Jonathin @ Jul 29 2009, 11:20 PM) *
I just log everyday. If it's the same day, it appends. If it's a new day, it makes a new log.

Much easier to handle that way.

Well, yes, until you've played for over two years and you have a folder the size of Rhode Island.

(EDIT: that's how I do it though)
Trevize
QUOTE (Soludra @ Jul 30 2009, 02:25 AM) *
QUOTE (Jonathin @ Jul 29 2009, 11:20 PM) *
I just log everyday. If it's the same day, it appends. If it's a new day, it makes a new log.

Much easier to handle that way.

Well, yes, until you've played for over two years and you have a folder the size of Rhode Island.

(EDIT: that's how I do it though)

I have folders per month named 'yy-mm', and logs by session named 'date time'.
Mado
anyone have a zmud script to set that style of autologging to start when you login ?
Sena
QUOTE (Mado @ Jul 30 2009, 06:44 AM) *
anyone have a zmud script to set that style of autologging to start when you login ?

Autologging is pretty easy.
CODE
#ALIAS atconnect {#LOG C:\<Full Path Here>\AchaeaLog~ %time( yyyy-mm-dd).txt}
#ALIAS atdisconnect {#LOG}

That will name the logs something like "AchaeaLog 2009-07-30.txt". That's what I use, and I have folders to separate the logs by year.

If you want to do what Trevize does (It sounds like the logs are named for the time when he connects?) you would need to create the folders for the month manually I think, since zMUD doesn't seem to be able to create folders, and then either log directly to the folder by including %time(yy-mm) in the file path, or log to a main folder and move them to the folder for the proper month when the log finishes. Then change the format of %time in the log's name to include the time, or whatever format you'd prefer. An example would be:
CODE
#ALIAS atconnect {#LOG C:\<Full Path Here>\%time(yy-mm)\%time("yy-mm-dd, hh:nn AM/PM").txt}
#ALIAS atdisconnect {#LOG}

That would create a log named "09-07-30, 10:37 AM.txt" in the folder "09-07". It would also start a new log for every time you connect to Achaea.
Penquin
QUOTE (Santar @ Jul 27 2009, 03:53 PM) *
I don't know, I've never really been into Pokemon.


I KNEW I remembered that from somewhere:

Damn you tongue.gif
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please click here.
Invision Power Board © 2001-2009 Invision Power Services, Inc.