More Awesome Than You!
Welcome, Guest. Please login or register.
2019 May 24, 12:23:50

Login with username, password and session length
Search:     Advanced search
539926 Posts in 18015 Topics by 7814 Members
Latest Member: daphnesim
* Home Help Search Login Register
+  More Awesome Than You!
|-+  TS2: Burnination
| |-+  Peasantry
| | |-+  The Compressorizer! Mass DBPF Compressing Program
0 Members and 1 Guest are viewing this topic. « previous next »
Pages: [1] 2 3 ... 7 THANKS THIS IS GREAT Print
Author Topic: The Compressorizer! Mass DBPF Compressing Program  (Read 93061 times)
jfade
Obtuse Oaf
***
Posts: 904


Esteemed Senator Emeritus


View Profile WWW
The Compressorizer! Mass DBPF Compressing Program
« on: 2007 May 08, 01:26:55 »
THANKS THIS IS GREAT

The Whaterizor?
The Compressorizer! (It eats your sims for breakfast!) It's a little utility I made that shells out to the nifty little dbpf-recompress program that benrg made and uploaded to Bowels of Trogdor here. Full credit to him for the awesome compression utility, I just made a pretty friendly, but ugly, interface to connect with it and make it easier for you to compress all your package files to a much smaller size!

But... Why?
There's no reason to not compress your files. EA/Maxis does and SimPE can (sometimes) but there was no easy way to do it, until now that is. With my tests, I compressed 73 MB of files to 37 MB. That's pretty much 50% smaller right there. Those of you with massive downloads folders will probably see even more benefit as this will help you make room for even more downloads! Tongue

OK, I'm Interested Now. Where do I start?
You'll need Microsoft's .NET Framework, version 1.1. This was written in C#.NET, and the source code will be released under GPL once I'm satisfied that it works properly. Since this is a debug version, it has all kinds of extra debug files with it, so the final version will be even smaller as it won't have those files along for the ride. Just extract the files to a folder somewhere, and start TheCompressorizer.exe. From there, it should be pretty self explanatory.

Important Stuff
As always, since this program's in beta, you'll want to BACK UP YOUR FILES before using it, especially since this program will change just about everything internally in a file that you point it at. Let me know about any problems by posting here, but I don't expect there to be any. It seems to work really well. Smiley

As it is now is pretty much the final product, though I will consider any suggestions about changes to the UI.

Enjoy! Smiley

Download: http://www.djssims.com/index.php?category=21
Screenshot: http://temp.djssims.com/beta/compressorizerscreen.jpg

Edit: Forgot the file links, heh.
Edit 2: The program has been officially released, get that version instead. Smiley
« Last Edit: 2007 May 26, 17:44:51 by jfade » Logged


Nifty Sims hacks and programs at: DJS Sims
syberspunk
Heretic
Terrible Twerp
****
Posts: 2365


ISTJ - what a crazy random happenstance


View Profile WWW
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #1 on: 2007 May 08, 01:45:21 »
THANKS THIS IS GREAT

Does compressing actually benefit you and reduce your loading times?  I thought the game still has to take time to uncompress files again in memory, no?

Oh... and thanks (to both you and benrg), this is great! Cheesy

Ste
Logged

jfade
Obtuse Oaf
***
Posts: 904


Esteemed Senator Emeritus


View Profile WWW
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #2 on: 2007 May 08, 01:55:14 »
THANKS THIS IS GREAT

Not actually sure if it has an impact on loading times, but if all the EA files are compressed, I don't see why we shouldn't have our downloads compressed. *Shrug*

I'd be interested to see the results though if someone did a benchmark type test on things and found out what impact, if any, compressed files have versus normal files.
Logged


Nifty Sims hacks and programs at: DJS Sims
dizzy
Souped!
*
Posts: 1572


unplugged


View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #3 on: 2007 May 08, 05:27:51 »
THANKS THIS IS GREAT

Works in Linux (Mono v1.2.3) though it doesn't look that great and of course the process fails (it doesn't try to open the exe in Wine after all).

Logged

jrd
Terrible Twerp
****
Posts: 2498



View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #4 on: 2007 May 08, 07:39:44 »
THANKS THIS IS GREAT

Is this safe for textures? Many textures, if compressed in SimPE, result in corrupt packages.
Logged
jrd
Terrible Twerp
****
Posts: 2498



View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #5 on: 2007 May 08, 20:16:51 »
THANKS THIS IS GREAT

Seems safe for textures!

Before: 1036MB
After: 489MB
------------------ -
Delta: 547MB

Very impressive.


A possible side-effect... my game loads significantly faster. I haven't made any configuration changes other than using this compresser, and it saved at least 2 minutes off the startup time.


----

If you're still taking feature requests: clear list would be nice (remove all files from list).
And an auto-focus, that if selecting a file, its before and after are highlighted to see the compression of any specific file.

----

Also, while "recursive" is the correct term, labelling it "scan subdirectories" may be more clear for all users.
« Last Edit: 2007 May 08, 20:43:18 by Jordi » Logged
aqualectrix
Blathering Buffoon
*
Posts: 80


View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #6 on: 2007 May 08, 20:57:10 »
THANKS THIS IS GREAT

Eh, the pherverstool and SimPE both use recursive.  I'd imagine most people using any sort of tool are used to that terminology at this point.

Anyway, if one were really attempting to accomodate the less-knowledgeable, one would have to use "subfolders" -- because your typical Windows user is not going to think in terms of directories.
Logged
Hecubus
Nitwitted Nuisance
***
Posts: 882


That's Numberwang!


View Profile WWW
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #7 on: 2007 May 08, 21:14:33 »
THANKS THIS IS GREAT

How would this work on other package files, such as those in the lot catalog or neighborhoods? Or is that borrowing trouble?
Logged

Cheezserver Fund: 27-Sep: $2518 We made out goal - WOOT!

I think one of the things that keeps a person sane is healthy skepticism about what you believe. Every now and then enjoy a conversation with an inner voice that says, "You're full of shit again." —Stewart Brand
jrd
Terrible Twerp
****
Posts: 2498



View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #8 on: 2007 May 08, 21:19:13 »
THANKS THIS IS GREAT

Seems to compress them without issues. I wouldn't run it on the install folders though.
« Last Edit: 2007 May 12, 07:22:16 by Jordi » Logged
Ambular
Cheese Nazi
Stupid Schlemiel
****
Posts: 1936



View Profile WWW
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #9 on: 2007 May 08, 22:47:09 »
THANKS THIS IS GREAT

The fellow who first posted the library jfade used for this said that it knocked 100 MB off his base-game installation and everything seemed to work fine.  That said, if you want to experiment with the base files, back everything up first!

jfade, it screwed something of mine up, but then I tried to do over 2 gigs at once, and also I know there were a couple of files I had that didn't like being compressed in SimPE and made things crash.  I'll try it again tonight, incrementally, and see if it works better that way.
Logged

Nihil curo de ista tua stulta superstitione.
My Sims 2 Stuff @  MTS | Populate My City
jrd
Terrible Twerp
****
Posts: 2498



View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #10 on: 2007 May 09, 07:02:06 »
THANKS THIS IS GREAT

Compressing base game install folders seems to work without problems, although I won't be surprised if I can't install the future Seasons patch 2 now. Shaved off about 75MB from a TS2+everything install.
Logged
Gwendolyne
Asinine Airhead

Posts: 6



View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #11 on: 2007 May 10, 18:27:45 »
THANKS THIS IS GREAT

Seems to work fine for me. Only tested it with my objects, yet. I noticed one file was compressed from 5000 kb to about 500. I only wish I knew which file. Can't you make that files list a little bigger so that I can see the filenames? Now I will go and test my loading time  Smiley
Logged
Ambular
Cheese Nazi
Stupid Schlemiel
****
Posts: 1936



View Profile WWW
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #12 on: 2007 May 10, 18:42:11 »
THANKS THIS IS GREAT

Can't you make that files list a little bigger so that I can see the filenames?

I second that request--a resizeable window for the filenames would be awesome!  (Better yet, one that lists only the filename with the folder path displayed separately at the top, rather than the entire path of every file.)  Also, a "Stop compressing" button would not go amiss.

It seems to be working fine though.  Got most of my files compressed now, one folder at a time, and the game runs without a hitch; I'll finish up the rest as soon as I can and post a final report.
Logged

Nihil curo de ista tua stulta superstitione.
My Sims 2 Stuff @  MTS | Populate My City
Baronetess
Lorelei
Grammar Police
*
Posts: 6512


I like pie. A cake is fine, too.


View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #13 on: 2007 May 11, 19:42:43 »
THANKS THIS IS GREAT

This is VERY shiny!

So, if a babygeek such as m'self wished to try this on, say, her Sims2 DL folder, the best way to do it would be to

1. backup DL folder (to external drive, or, at the bare minimum, b/up the folder(s) I am about to compress)
2. run Magic Ensquishifier tool
3. attempt to load Sims 2
4. lather, rinse, repeat until all folders in DL folder are de-embiggened?

Yes, no, "don't touch it, it is too shiny for the likes of you"?
Logged


Super INTJ.    MATY's Big Cat.    LOLcult.   Pescado: Like the ancient Egyptians, the Internet worships cats.
Ambular
Cheese Nazi
Stupid Schlemiel
****
Posts: 1936



View Profile WWW
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #14 on: 2007 May 11, 20:50:00 »
THANKS THIS IS GREAT

This is VERY shiny!

So, if a babygeek such as m'self wished to try this on, say, her Sims2 DL folder, the best way to do it would be to

1. backup DL folder (to external drive, or, at the bare minimum, b/up the folder(s) I am about to compress)
2. run Magic Ensquishifier tool
3. attempt to load Sims 2
4. lather, rinse, repeat until all folders in DL folder are de-embiggened?

That's about the size of it.

ETA: Probably a good idea to delete the groups.cache file from your EA Games/The Sims 2 folder before you run the game for the first time, too.

Oh, jfade, one other small thing that would be really nice is if the directory listing in the Add Files to List dialogue would remember the last folder you ensquishified...
Logged

Nihil curo de ista tua stulta superstitione.
My Sims 2 Stuff @  MTS | Populate My City
Li'l Brudder
The Quitter
Stupid Schlemiel
****
Posts: 1612



View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #15 on: 2007 May 12, 02:51:06 »
THANKS THIS IS GREAT

I just compressed the DL folder itself.  All the contents were squishinated.
Logged
Ambular
Cheese Nazi
Stupid Schlemiel
****
Posts: 1936



View Profile WWW
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #16 on: 2007 May 12, 02:57:15 »
THANKS THIS IS GREAT

I just compressed the DL folder itself.  All the contents were squishinated.

Well, that seems to work well for some people, not so much for others.  I just recommend folder by folder because that's what worked for me.  :p
Logged

Nihil curo de ista tua stulta superstitione.
My Sims 2 Stuff @  MTS | Populate My City
Li'l Brudder
The Quitter
Stupid Schlemiel
****
Posts: 1612



View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #17 on: 2007 May 12, 03:00:11 »
THANKS THIS IS GREAT

And I for mine.  :-P
Logged
jfade
Obtuse Oaf
***
Posts: 904


Esteemed Senator Emeritus


View Profile WWW
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #18 on: 2007 May 12, 03:21:54 »
THANKS THIS IS GREAT

Quote
If you're still taking feature requests: clear list would be nice (remove all files from list).
And an auto-focus, that if selecting a file, its before and after are highlighted to see the compression of any specific file.
Quote
I only wish I knew which file. Can't you make that files list a little bigger so that I can see the filenames?
Quote
Oh, jfade, one other small thing that would be really nice is if the directory listing in the Add Files to List dialogue would remember the last folder you ensquishified...

Working on all those features now. Smiley Thanks for the feedback so far! Smiley
Logged


Nifty Sims hacks and programs at: DJS Sims
Baronetess
Lorelei
Grammar Police
*
Posts: 6512


I like pie. A cake is fine, too.


View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #19 on: 2007 May 12, 07:09:17 »
THANKS THIS IS GREAT

I just compressed the DL folder itself.  All the contents were squishinated.

Well, that seems to work well for some people, not so much for others.  I just recommend folder by folder because that's what worked for me.  :p

Mine's at 13G, so I think I'd be courting trouble.

This won't cause other tools to fail, such as SimCat / S2PCleanInstall / S2HDetect, right? I can't see how it would, but if the ensquishinator is altering files....     

Logged


Super INTJ.    MATY's Big Cat.    LOLcult.   Pescado: Like the ancient Egyptians, the Internet worships cats.
SaraMK
Nefarious!
Terrible Twerp
****
Posts: 2038


Playing again.


View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #20 on: 2007 May 12, 07:30:35 »
THANKS THIS IS GREAT

One of my files went from 2775 to 45. I fear for this file....

I'm now going to see if compressing a huge Downloads folder (19,570 files, 6.13 GB) will do anything to loading times.
Logged

Fail.
jrd
Terrible Twerp
****
Posts: 2498



View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #21 on: 2007 May 12, 07:35:05 »
THANKS THIS IS GREAT

SaraMK - look closer. The numbers do not scroll right, the left column is one more down than the right (or was it the other way? Anyway they're not in sync).

Load times definitely are affected by this tool. I went from ~6 minutes to less than 2.
Logged
SaraMK
Nefarious!
Terrible Twerp
****
Posts: 2038


Playing again.


View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #22 on: 2007 May 12, 07:36:53 »
THANKS THIS IS GREAT

That was the only file I had in a subfolder, so it definitely went down to 45 as long as the program is reporting correctly.
Logged

Fail.
jrd
Terrible Twerp
****
Posts: 2498



View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #23 on: 2007 May 12, 07:49:42 »
THANKS THIS IS GREAT

Huh, weird. But possible... I had one file that went down from over 2000 to less than 100 as well. It was riddled with text based resources and nothing compressed (text compresses really well). The file definitely works still.
It is a property set overrider I have for my own use, which I never compressed because it is too large to do so in SimPE (took more than 20 minutes before it completely hung, so I left it be). The compressorizer took far less time (about 90s or so).
Logged
Gwill
Terrible Twerp
****
Posts: 2162



View Profile
Re: The Compressorizer! Mass DBPF Compressing Program
« Reply #24 on: 2007 May 12, 12:23:56 »
THANKS THIS IS GREAT

I'm very frightened of this, but I'm going to give it a try.
Logged

Dibs on Darth Telligent!
INTJ bordering on P
Want to know where babies come from?
Pages: [1] 2 3 ... 7 Print 
« previous next »
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.21 | SMF © 2015, Simple Machines Valid XHTML 1.0! Valid CSS!
Page created in 0.105 seconds with 19 queries.