Database Users

UPX - Compression app to free up space

I found this thread on aximsite, a forum I still visit from when I had a Dell Axim and it looked interesting. I didn't find the app in a search here, so I thought I'd post it for anyone who might be interested.
UPX is apparently an app that lets you compress .exe and .dll files without really impacting perfomance in any noticeable way (per the postings in the thread.) I haven't tried it yet, but might give it a shot. It seems the app is not resident on the pocket PC, but needs have files moved to the pc, compressed, then moved back. It's a little bit of work, but it only needs to be done once, so after the set up, it sounds like you're good to go.
Anyway, just thought I'd pass it on as an FYI for anyone who might be interested.
Oh yeah, and it's free too.

Finally UPX is available for WinCE. You should have posted in "General" in the first place.
This program makes your programs even start faster (less to read from usually slow SD card, storage, ...).

For a non-technical person, I am a bit confused... Reading thru the thread, it seems that more ram are required to run the compressed apps.
What exactly do we gain if the apps are stored on a storage card where storage space is not really the issue? Need help.

Wow, thank God. UPX is old skool genius.
Can someone give it a go on the enormous Skype executable? I'm not near my phone for a while and can't check it.
V

vijay, I tested it on the big MobileNavigator.exe which is around 3,7 MB originally. UPX'd only 1,1 MB or so. And it runs! Even Voice Command (300KB down to 100KB). Since I have it installed in Storage it starts faster (Storage is soo slow).

Thank goodness. This is a God send, when reversing PPC binaries you can see that they're full of so much slack.
I had a look at UPX quite a while ago - I use it to compress all my PC VB and C++ stuff, but was disappointed to find it didn't work on PPC. I'm now.
Decompressing presumably incurrs some overhead, but it'll help us out when we've got limited storage.
V

vijay555 said:
Decompressing presumably incurrs some overhead, but it'll help us out when we've got limited storage.
Click to expand...
Click to collapse
I can't agree with that. You can read on the authors page, that
http://upx.sf.net/ said:
Your executables suffer no memory overhead or other drawbacks because of in-place decompression.
Click to expand...
Click to collapse
Although decompression takes some time it is still faster, because it is read into RAM a few times faster than it normally would. This saves more time than it takes.

Good point Chatty. My concern was CPU overhead on slower processors (OMAP), but as you say, since you're using RAM or faster storage, it'll probably compensate.
V

i tried it with opera and tomtom which are both on my main memory
results:
original opera startup 14 sec
upx opera startup 9 sec
original tomtom startup 15 sec
upx tomtom startup 14 sec
i also tried it with tcpmp which is on my SD card
original tcpmp startup 3 sec
upx tcpmp startup 2,5 sec
so it seems to speed things up a little
HOWEVER... in opera the the '-' buttons dont work anymore.. they do work when you use them through the touch screen though..
and the text ('Stop'/'Go to' and 'Menu') is aligned to the left of the screen instead of the normal at 1/3rd and 2/3rd of the screen.
--------------------------------------------
[edit] extra information
original opera 4,86mb
upx opera 1,63mb
original tomtom 2,62mb
upx tomtom 1,67mb
original tcpmp 1,21mb
upx tcpmp 1,21mb
not only a speed gain but it also saves room

OPERA
after a few tests i found out the opera.dll is responsible for the movement of the ´-´ buttons and the not functioning with the keyboard
the opera.exe, xmlparse.dll and zip.dll have nothing to do with it..
with the upx´ed above three and the standard opera.dll startup takes 12 sec so its still some faster then all original files
however the original opera.dll is 4,74mb and the upx opera.dll is 1,57mb, so it doesnt save much room :!:
im just glad ill receive a 4gb SD card today which will give me some extra breathing room compared to my 512mb

Re: OPERA
Bartjan said:
however the original opera.dll is 4,74mb and the upx opera.dll is 1,57mb, so it doesnt save much room :!:
Click to expand...
Click to collapse
1/3! What do/did you expect? I find this rather great!

i meant:
when you use the original opera.dll so the ´-´ buttons still work right, you dont save much room compared to the all original opera :roll:

I went through last night and UPX'd every DLL and EXE that I could, including WisBar (and Desktop), Resco, Opera, PocketInformant and other stuff.
PocketInformant won't start if one of the DLLs is UPX'd, but I don't remember which one. The rest of them and all the EXEs are fine.
Opera - as above. Screw the soft keys, 3MB is a lot of slack to be rid of.
Resco was interesting. The Today plugin messed up at one point, and the Explorer went completely scatty with fonts. Even after uncompressing all the Resco files again the Encrypt/Decrypt context menu items were blank but functioning.
WisBar (compressed) can now live in the 10MB Ext_ROM along with Opera and Resco.
All in all it is something to use carefully, but can save a LOT of space.

Hmm.. so far the responses from the trial seems good. I'll give it a try too later this weekend
--- UPDATE (12 May 06) ---
My results, using UPX -9 (e.g. max compression)
All programs are working so far, but performance are negligible (e.g. less than 2 seconds improvements)
from \Windows
PITools.dll 1.18M -> 504K (save 700K)
from \Program Files
Mobibook.exe : 1.61M -> 619K (save 1.0M)
Tom tom navigator : 1.59 -> 692 (save 900K)
WorldMate.exe : 747K -> 207K (540K)
So, that is a saving of 3M of space! Anyway, for those of you that are adventurous, there are various 500K size dll files in \Windows folder, which I doubt can save much (e.g. the effort/space ratio isn't that attractive).
Anyway, I've found the following files on \Windows that seems to be compressable.
ppt.exe (powerpoint)
gwes.exe (???) <-- DO NOT RUN. It will hang your unit.
gdiplus.dll (???)
msxml3.dll (???)
However, I'm not sure if it is a good idea to compress the ppt that is in ROM, and others are unknown programs (e.g. not sure how to test it after compression)
I've also looked around my SD card and found the Tennis.exe game that I have, that is 2.4M in size which were then compressed downed to 2.17M, which is a bit disappointing. I didn't test if it runs on my unit or not.

hanmin said:
Hmm.. so far the responses from the trial seems good. I'll give it a try too later this weekend
Click to expand...
Click to collapse
An pages anywhere with a list of what NOT to compress?

This is an excellent app! I have compressed all of my apps and have not had any problems.
The big ones for me are PlanMaker and TextMaker - both have compressed to a fraction of their original size. Infact I was running a little tight on space I hadn't even installed TextMaker. But now I have compressed both it isn't a problem.
The only strange one so far is ListPro which works fine but loses it's icon.
I haven't tried to compress everything possible, just the apps and may be the main dll.
I have now got about 5mb more storage space than when I started with TextMaker installed.
Excellent!

hanmin said:
Anyway, I've found the following files on \Windows that seems to be compressable.
ppt.exe (powerpoint)
gwes.exe (???) <-- DO NOT RUN. It will hang your unit.
gdiplus.dll (???)
msxml3.dll (???)
However, I'm not sure if it is a good idea to compress the ppt that is in ROM, and others are unknown programs (e.g. not sure how to test it after compression)
Click to expand...
Click to collapse
You're right that compressing something that is in ROM isn't a good idea, that takes up space!
If you have a file in ROM like \windows\PPT.EXE and it is 1MB in size, then compress it to 500KB, copy it back to \windows, you actually USE 500KB of Program Storage rather than saving it.
Your ROM is Read Only, you can't delete files from it or overwrite them.
What actually happens is that you create another file with the same name and the OS ignores the one in ROM.
I do this with ClearStorage.exe.
I created a .TXT file and in it put
Code:
Clear Storage is dangerous.
then renamed it to ClearStorage.exe. I put it in the \windows folder to stop anyone erasing my device by accident(!).
If I need to clear my device I can delete the file and the original ClearStorage.exe is still there.
Try it yourself.
There is no easy way to save space.
If you want to load your apps to ROM and delete the crap ones that come with the OS this will work, but you will have to decode the ROM, edit the hive files, re-encode the ROM and flash it.
This is no small task, but it can be done (I plan on doing it myself actually).

Wow - This is fantastic. In just a short amount of time I have saved several meg of space, and some programs (such as TomTom) run significantly faster.
Superb!
Cheers
Rowan

Amazing. My Big Storage now BIGGER

Some results (on a Wizard)
MS Communicator Mobile - Compressed the exe and one dll down to 33% (1.3mb). The app would not run with one dll (lclang-res96.dll) compressed.
GoodLink - Compressed GoodApp.exe (the biggest file) from 3.5mb to 1.2mb successfully, however by compressing the largest dll (GoodLinkRes_EN.dll) I lost the soft key labels (and probably some other stuff).
TomTom Navigator - 41%
MS VoiceCommand - Compressed from 1.6mb to .6mb
Those were my big files on my device. Using UPX gained me an extra 6mb storage memory - which was a 50% increase (I went from 12 to 18 ). Off to try it now on my Storage Card apps.
Also, .NET files are not currently supported.

can u use sd card for program memory?

hi, I'd like to know if you can use the sd card and say partition it so that you can make your xda exec device use the storage on it as programe memory so it speeds the device up. this really is a fab device, but it really lacks the memory capacity that I had on a blue angel.
I have a 1gb sd card and don't mind loosing any storage space to accomplish this. if there isn't a way, can someone try and find a reg tweek for this....
anyway, I leave it with you...
cheers.
joey jojo

I think this is something which should be taken as a clue by developers who make programs such as Memaid, Pocket Mechanic, etc and include this as a a feature. Maybe the concept will be something similar to the Virtual Memory on a regular windows pc.
You are absolutely right, I too really miss the shortage of program memory. I can never open a really complicated web page with lots of images in Netfront before I get the dreadful warning that I have run out of program memory.
I hope some developer picks this up and incorporates this as a feature. I am sure this will increase his sales many many times.
Regards

you can put your internet explorer's cache on the sd-card...
[HKEY_CURRENT_USER\Software\Microsoft\Windows\CurrentVersion\Explorer\Shell Folders\Cache]
change cache from '\windows\profiles\guest\temporari internet files' to '\SD_MMCard' to achieve this...
however you'll notice that it only slows your device incredibly down if your SD-Card is not set up right
see also http://forum.xda-developers.com/viewtopic.php?t=50301

There is just no way a third party program can add this. On the windows mobile team blog, there's a post from a few months back talking about doing virtual mem on the SD card, and basically, it's just not in the OS and won't be until at least WM6, and third-party programs can't do it.

JasperJanssen said:
There is just no way a third party program can add this. On the windows mobile team blog, there's a post from a few months back talking about doing virtual mem on the SD card, and basically, it's just not in the OS and won't be until at least WM6, and third-party programs can't do it.
Click to expand...
Click to collapse
Those are very disappointing news...

Speaking of memory management and the OS itself..I really wonder during the development of WM5, did they try to come up with a better OS, or just building up upon WM2003.
Reason why I say this is my Universal crashed yesterday, and a look into the "Memory" panel in the Settings showed the OLD memory management screen along with the sliders and all... :lol:
Looks like the developers got lazy and just placed a panel on top of the old one :lol:

Ehh.. You guys want to be buying new SD cards every third month?
Flash memory like the SD cards have only a limited number of write operations before they fail.
Using them for storage is good, because you don't write to the cards that much.
Using them as memory would totally screw up the card in a rather short time.
And, I think using SD card for program memory would result in a slower application, because of the read/write speed of the SD compared to the RAM..
--- EDIT ---
3 months is just a figure of speach..
I have no idea of how much time it would take before failure occurs..
It would probably result in slower and slower performance, because some sectors would be worn out faster than others..

What you say about the writes before failure is right, but when you are faced with a £300 PDA that has the same amount of RAM as my little finger, you have to do something.
SD cards are cheap enough these days, and money grows on trees. I'd rather be able to leave programs open and not worry about how much it will slow the machine down to have more that three big apps running than I would be about coughing up for a new SD card every 3 months.
I have seen a 4GB card on Ebay for less than £80, Tescos sell 1GB for £30 these days.
The great thing about Tescos is their guarantee. You buy the card, write it to death, take it back for a full refund, no questions asked.

Tmobile Wing ship ROM low memory

Hello everyone, so I got the T-mobile wing wich is the same as the Herald a couple of days ago, and the first thing I checked when I turned it on was the program memory and it was very disappointing at around 17MB then it went down from there I never saw the 17 again, I have a few apps installed and now my memory is around 9MB after soft reset. I am not liking this about this device especially after been spoiled with the Core 2.0n ROm on my MDA (wizard) I had more apps installed and still had over 25 MB of program memory left, as far as I know the only way to make this better is to flash it with a cooked rom, but since that is too risky at this point with not having a ship rom to go to if phone gets briked I am wondering if anyone has any thoughts or solutions for this issue.
by the way I think other then the size of the wing I like the wizard better in many ways. share your thoughts.

Hummm... Are you installing your programs in storage memory or at the memory card? With exception of programs that interfere with the today screen, like wisbar advance for example, all programs should be installed in the memory card.
I have 19MB of storage memory still available... I've installed 19 programs, and only 5 are in the storage memory

BRSG said:
Hummm... Are you installing your programs in storage memory or at the memory card? With exception of programs that interfere with the today screen, like wisbar advance for example, all programs should be installed in the memory card.
I have 19MB of storage memory still available... I've installed 19 programs, and only 5 are in the storage memory
Click to expand...
Click to collapse
I always install all programs on th mmory card I have a 2GB and I have 15 apps installed and 24.4 MB internal storage memory left so that one is ok, but I was talking about RAM memory that programs need to run not storage memory the on the right side when ou open the memory screen.

The problem is the pagepool.
All cooked rom for wizard have 4 or 8MB pagepool because that´s enough. I guess on wing it is the normal 12MB - too much.
We have to cook smaler ones and we will get back the big RAM like 30MB.
Let´s wait for official update and start cooking without the possibility of bricking.
lol

FZZF said:
I always install all programs on th mmory card I have a 2GB and I have 15 apps installed and 24.4 MB internal storage memory left so that one is ok, but I was talking about RAM memory that programs need to run not storage memory the on the right side when ou open the memory screen.
Click to expand...
Click to collapse
Weird It is a fact that more today plugins result in less program memory, and there are some programs that even not being placed in today screen need alot of memory to run. I have about 20MB of free program memory. Maybe you should try to see which programs are using that much memory to run...

low memory on wing
I am experiencing the same thing. It sad when you have no programs running except for Activesync, and you can not even power up the camera. I have a T-mobile WdG care rep looking into it. The only other program i have installed is the slingplayer. I also have notice the a sling player error message showing not enough memory.

BRSG said:
Weird It is a fact that more today plugins result in less program memory, and there are some programs that even not being placed in today screen need alot of memory to run. I have about 20MB of free program memory. Maybe you should try to see which programs are using that much memory to run...
Click to expand...
Click to collapse
You have the HTC p4350 so I am sure it's runing on different rom, I think the problem is with the T-Mobile USA Rom, it has too much crap on it I even did a soft reset right before customization to prevent the t-MO stuff to install and that gave me an extra 7MB of storage but no better on the program memory and the timobile stuff still installed. I did turn off all plug ins I even shut down all unnecessary processes with memmaid and the best I got was 13MB so I am pretty sure it's the rom and I thnk Papa is right it may have to do with the page pool and or a combination of both page pool and all the T-Mobile garbage in the rom.

cyberjr said:
I am experiencing the same thing. It sad when you have no programs running except for Activesync, and you can not even power up the camera. I have a T-mobile WdG care rep looking into it. The only other program i have installed is the slingplayer. I also have notice the a sling player error message showing not enough memory.
Click to expand...
Click to collapse
yes it is sad when a cooked rom is a million times better then a ship rom made by the biggest software company in the world as Papa said I am waiting for an updated rom to be available to go back to in case something goes wrong while flashing a cooked rom, and it is only a matter of time before we can flash custom roms question is how long, I dont know how long I can handle the frustration of using this thing I installed IGO GPS yesterday and it would not run because of lack of memory so I think I am going back to the wizard until I can flash this dumb thing and by the way I don't think the T-mobile rep will come up with a solution but if he does please share it with us.

A lot of tweaking needed
I had to use Memmaid and move dll's to storage card and moved IE cache and email attachments to storage card too. Then I killed Live Search from the startup services as well as removed all things in the startup folder except services.lnk. I have two apps on the today screen and I am booting up with 20mb's free. It took some time but this will be a temporary fix until new ROM's make it here.

Using the dumped rom from the thread in the mobile 6 forum I was able to change the pagepool to 4 as well as strip out most of t-mobile's junk. While stripping out the extras did help, i'm not convinced that changing the pagepool will help. It certainly did increase the amount of free ram (27 at start dropping and hovering at 19 after several days) however I started noticing weird issues that I hadn't noticed with a 12 mb pagepool. Things like the today screen not refreshing or the wlan not starting. I'm think some of the device drivers may need to stay resident in the pagepool for normal functionality.
Overall, I've switched back to the 12 mb pagepool and everything works perfectly. The amount of free ram does get pretty low (around 4 mb) after opening all my programs but everything will still operate normally. I suspect the number reported may be somewhat misleading (like linux and vista) where it is using your free ram for caching purposes. Again i am basing this off the fact that everything will still load and work normally with low reported free ram. This is just a very long way to say that changing pagepool may introduce a new set of problems.

dll
kevinwatson5 said:
I had to use Memmaid and move dll's to storage card and moved IE cache and email attachments to storage card too. Then I killed Live Search from the startup services as well as removed all things in the startup folder except services.lnk. I have two apps on the today screen and I am booting up with 20mb's free. It took some time but this will be a temporary fix until new ROM's make it here.
Click to expand...
Click to collapse
did u move all the dll's to the storage card on the tmobile wing?

interesting, I tried runing IGO nav and it reported an error saying it needed 6MB of memory to run I had to soft reset to get it to work, last night I installed SKTools and did some more tweeking with it and gained about 2MB of memory but not much I am wondering if the rom has some memory leaks somewhere because I can't even fin what apps are using so much memory at start up I got rid of most of them the only one I cant get rid of it the myfavs.

ericizzy1 said:
did u move all the dll's to the storage card on the tmobile wing?
Click to expand...
Click to collapse
not all dlls will move like the omap and a few system dll's but I moved almost 8 I think, depends on how many apps you have installed too. I uninstalled some of the system software like oz im and tmobile mail wizard and had all of them running off the storage card too. I am getting 20mb free upon bootup and all the things are working as far as I know.

hi
kevinwatson5 said:
not all dlls will move like the omap and a few system dll's but I moved almost 8 I think, depends on how many apps you have installed too. I uninstalled some of the system software like oz im and tmobile mail wizard and had all of them running off the storage card too. I am getting 20mb free upon bootup and all the things are working as far as I know.
Click to expand...
Click to collapse
if u could only tell me which dll's(that came installed on the wing) u moved, it will be great.

dll's
I moved everyone that Memmaid would allow me to move, the ones that were in use could not be moved and that was only a couple.

Here's what I did and I have like 15mb to spare
I did a hard reset on my Wing - then, when T-mo's customizations started/tried to run, I did a soft reset (thus preventing their installation).
From this point I installed any and everything that i wished to have on my phone
(in my case this consisted of: total Commander; Sleuth's WM6VOIP; HTC Home Plug Today Plugin; RvBCrS HTC Startup animation; A_C Slide2Unlock; Chi-Tai Dang batteryStatus TD-Plugin; T-Mobile Soft Key Applet; PPCSoft psShutXP; HTC Audio Manager; The Equinoxe Wizard Retouched Dialer2; and By Boto XDA-Developers HTC Touch Comm Manager)
As you can see, I installed a lot of stuff and still I have sufficient room left on my device. will say that inevitably you may want to reset your device about once a day or so - because it appears to slow down and lose memory over time, but all in all it's no worse than my MDA ever was, plus I still have my MDA if I missed it that much (Which I don't).

xander803 said:
Using the dumped rom from the thread in the mobile 6 forum I was able to change the pagepool to 4 as well as strip out most of t-mobile's junk. While stripping out the extras did help, i'm not convinced that changing the pagepool will help. It certainly did increase the amount of free ram (27 at start dropping and hovering at 19 after several days) however I started noticing weird issues that I hadn't noticed with a 12 mb pagepool. Things like the today screen not refreshing or the wlan not starting. I'm think some of the device drivers may need to stay resident in the pagepool for normal functionality.
Overall, I've switched back to the 12 mb pagepool and everything works perfectly. The amount of free ram does get pretty low (around 4 mb) after opening all my programs but everything will still operate normally. I suspect the number reported may be somewhat misleading (like linux and vista) where it is using your free ram for caching purposes. Again i am basing this off the fact that everything will still load and work normally with low reported free ram. This is just a very long way to say that changing pagepool may introduce a new set of problems.
Click to expand...
Click to collapse
Is it possible to use an empty extended rom to stop some of those problems???

Just want to share the info on solving the problem with the Wing mem problem.
I read and followed the instruction HERE. I have set the cache mem to 6mb. I now always have 11-15mb available and the phone is responsive. And the phone is been going strong for 2 days.

dangtong said:
Just want to share the info on solving the problem with the Wing mem problem.
I read and followed the instruction HERE. I have set the cache mem to 6mb. I now always have 11-15mb available and the phone is responsive. And the phone is been going strong for 2 days.
Click to expand...
Click to collapse
What are you running in background??????
I have 26MB free while SPB mobile shell, today agenda and batterystatus are running - and 22MB when activesync is connected!
BUT i have the terra. But even without pagepoolchanging i had 20MB free. After all programs are installed.
So what are you running?????

got 8 free and only Mobile shell, Phone Suit and Weather running
**** this device

New reg-hack: MemHack. Pre-Alpha.

I fiddled around with my wm6'd hx4700 (thanks kuzuhara!) and a registry editor and found a way to make it regard SD as ram and xip from it.
This renders my device to achieve usage smooth enough i allow myself to reffer to the device as a mini-umpc^_^
For SD only atm, miniSD may or may not work depending on your devices driver. No MMC for the time being.
I sooooo hope this isn't old news
Here's to me not ****ing any of your devices up, it worked wonders for me.
P.S
IMPORTANT!
Delete the Program Files folder and reset again once you see the SD's been renamed to Program Files2.
On the next boot it'll mount as Program Files and everything will load from it.
Excuse me, my brains are stuck in google translator mode
4.11.2007
It seems i was rather in the wrong and am taking a whole new direction.
One which involves reading more carefully before i charge head into the guts of windows embedded.
Will take me a while until next post, and it might become hx4700 exclusive, but i promise you some cool stuff to come yet.
Anybody wanting to make their SD into Program Files to save space,
just start resco reg editor and change hklm\System\StorageManager\Profiles\SDMemory\Folder: Program Files.
(Originally is SD Card).
You can also try messing with it, making it into diffenent sys folders, just be careful
Mine is currently application cache (Volatile) and [email protected] Files.
(Running sweet with what i got to with the enablement of complete graphics accelaration, except for a minor hang up when returning from sleep).
Sooooooooooo...
ONLY DOWNLOAD AND APPLY THE CURRENT PATCH IF YOU KNOW WHAT YOUR'E DOING AND WANT TO GIVE BEATING ME TO IT A SHOT!
I'm hoping for a next release in a day, but not necessarily of this project but of an off-chute.
BTW, is it just me or is WM real *nix like?^^

anyone tried this ?

ranasrule said:
anyone tried this ?
Click to expand...
Click to collapse
Downloaded, but waiting to see what others think.
Want to know what it does to the SD card and device as the readme does say to move the devices contents of its program files folder to the sd card?????

downloaded it too. but i notice its his forst post.

Lol... it's my first post, sorry..
All it does is make the device call the card drive "Program Files" and set a swap file that's used as most device memory (don't worry, it's faster than most none-nand flash). i had to leave a small buffer in device memory though.
The memory file is unallocated, so just don't forget to leave 528MB free at all times.

Re-read the original post
It is and will be updated with periodic updates should they come.

I've been using it for 72 hours now.
It takes the odd reset to free up memory, but nothing worst than what we had before.

well if all thing got wrong.. anyway to revert it back?.. well ofcourse hard reset is one of it. uhmm.. lets put hardreset aside first..

well.. cant wait to test this.. i made a whole backup of my registry so if thing went wrong.. ill just restore the registry backup..

Good point doube_ofour.
Just export the StorageManager registry key before applying the changes, and if worst comes to worst restore your backed up original.

So, anybody else installed and can connect to tell the tale?

DuperMan said:
So, anybody else installed and can connect to tell the tale?
Click to expand...
Click to collapse
I made a cab with the regs and installed it But I'm still experimenting .. Nothing bad happened so far how do i know the device is faster ?!! how did you measured your device's speed ?

So let me get this straight -- it will use the microSD in my TyTN as RAM -- the icky sticky stuff I run out of because internet explorer, pocket player, and spb mobile shell grab it all for themselves?
Is there any way to specify how much of the SD card is used as RAM -- since I don't really need 1 GB of RAM on my device.
I saw your post about 558 MB free but didn't quite understand it. You also said you need the odd softreset to free memory? but why would you need to free up a few MB when you have access to hundreds?
But thanks for sharing with the community -- if this really does work out well for us, that's pretty freaking amazing.

@DuperMan
Does this hack simply make our "Storage Card" transform into "Program Files"?.. Thats it?.. cant see any speed improvement.. besides my memory usage increased by that means my device will perform slow..
My "Program Memory and Storage Memory" Stays the same as 47mb total on both memory..

Exactly Ragart!
Only it's set to use miniSD, i think you'd have to mess with it a little to make it work on miniSD... if response is good i'll make a mini version.
Remember - It's only been tested on wm6 hx4700!

double_ofour said:
@DuperMan
Does this hack simply make our "Storage Card" transform into "Program Files"?.. Thats it?.. cant see any speed improvement.. besides my memory usage increased by that means my device will perform slow..
My "Program Memory and Storage Memory" Stays the same as 47mb total on both memory..
Click to expand...
Click to collapse
in my case my program memory decreased by something around 10mb ! and I can't see any improvement in speed too ...

miniSD, hmm? Well that's the slightly-larger brother of my 1GB MicroSD. So I guess I'll just watch the thread and see others' reactions before I try anything (though I do have fullbackups)
Thanks for the quick response. So how much RAM does your hx4700 'have' now? and did you set it to 558 extra for a reason? Just curious questions from a person who doesn't understand the intricacies of reg editing

@doube_ofour:
Use it for a while, constant usage should be smoother. Did you free the space up by deleting the old Program Files as well?
Use it to surf for a while, multiple windows style, and you'll notice the difference.
Also, don't be mean to my hack Don't load it to spite, wait for each app to load and keep on starting apps without (majorly) worrying about a system crash.
@hma4:
The age old method of feel
It doesn't boost anything per say, but your device shouldn't be as compaction ridden as it was, so less mem degradation over time=more time between resets under heavy work loads. and i mean heavy. also, multi-tasking is MUCH more usable.

@ragart:
I set it to have a 512Mb paging area on the SD, plus 512kb in main for caching and another 16Mb for caching on SD, so that's a total of 528.5Mb overall mem, 16.5Mb cache and half a gig paging (good for them internet chaches etc..

i check on the registry that u have made in ur reg hack. seems like all the folders etc is the same even for a miniSD card ... so do u think it will work on miniSD too?

sygic cant calculate routes above 250 km

hello fellow chefs
i have a problem that whas brought to my attention by a user of my blackstone rom
he uses sygic as navigation and he wanted to calculate a route from netherlands to france and it cant finish calculating as it says it runs out of memory:s
when i tap the taskmaanger it mostly says arround 60% so i gues there is enough also when i look at storage in taskmanager it says
total 191.05 mb
in use 93 mb
free 98.05 mb (these valeus are after a soft reset with 49%)
there is more free then in use so i guess there is enough
also he pointed me to a program where you could test ram wich isnt working on my rom but is working on multiple other roms he has used:S
i also tried it myself by downloading sygic and i came to the same conclusion:S
also the program tells me the same when i want to do a ram check
when i start the program it says at least 21.25 mb free space is needed on the storage device
when i look at taskmanger at the storage section it tells me i have 255 mb free:S
you guys can downlaod the program here: http://rapidshare.com/files/334876190/pocketmechanic.2.99.283.CBD.zip
its a free program so no warezlink
when you instal the program and open it you have the option card benchmark
there you can choose over wich memory you want to perform it
when i say ram it tells me 15% of my ram is used and
302.25mb, 84.68% free
by my calculation 84% of 302 is way more then then the 21 mb the cecker talks about:-o
hope some one can help me solve this strange ram problem as i think the calculation fails of the strange ram thing
edit: gonna put the memorymap from my buildlog here maybe you can see something there
as it says by ram 43 free:-o still its more then the 21 the ram chacker talks about:s
Code:
Memory Map...
SLOT 0: 0x02000000 - 0x018b0000 (END: 0x00060000, 0 MODULES)
0x02000000 - 0x01fc0000 - ROM 0
0x01f80000 - 0x018b0000 - ROM 1
SLOT 1: 0x04000000 - 0x02020000 (END: 0x02020000, 211 MODULES)
SLOT 60: 0x7a000000 - 0x78e40000 (END: 0x78020000, 52 MODULES)
SLOT 61: 0x7c000000 - 0x7a022000 (END: 0x7a020000, 239 MODULES)
RAM IMAGE: 0x80000000 - 0x803e6560
RAM: 0x803e7000 - 0x80475000 - Used for kernel modules
0x80475000 - 0x83000000 - 43 MB free

bumping my 1 post question and got another one
can someone share the htc in call recoreder package including certificates?
thanks in advance

It's probably running out of virtual memory in the slot used by sygic.

Farmer Ted said:
It's probably running out of virtual memory in the slot used by sygic.
Click to expand...
Click to collapse
and can this be changed cause he says he only has the problem with the rom i make:S

How big do you have the datacache (and others in boot.rgu) set? Maybe that's a problem, if it's too big. You should run virtualmemory.exe while the app is running to see if the problem is virtual memory management.

every setting i have is found here on xda so i gues everybody should have the problem then as all of them are in hd2 general section
also the bootrgu i have changed one thing there wich is
[HKEY_LOCAL_MACHINE\System\StorageManager\Profiles\FLASHDRV\FATFS]
"DataCacheSize"=dword:00001000 ;4096 sectors(4096*2048=8MB)
normally this whas at 4 mb but found it in a pdf from da_g i believe that you could set it to 8 but on the default valeu and the 8 mb valeu does the same
so i dont thing its this setting thats interferring:-o
will try that program you mentioned
anything special i need to look at there
edit: any chance you can point in the direction where to download that program as i cant seem to find it only source code:S
edit2: never mind after some more googling i found you already posted it somewhere thanks

maybe bit of a noob question but where does the program puts the snapshot:-o
i made two but i cant seem to find them stored anywhere:-o

You need to take a screen-cap; it doesn't save the snapshots for you.

Farmer Ted said:
You need to take a screen-cap; it doesn't save the snapshots for you.
Click to expand...
Click to collapse
lol
i saw snapshot so i thought it whas to make a picture
here is a foto of the phone in idle after a day of use
i first did the snapshot as im not sure what it does
can you see something strange on the picture?

So, you don't have sygic running in that one? Slot 15 is pretty porky; what process is that? You need to scroll left and right to see the processes for each slot. You may need to run vol d-pad to do that on the HD, though. Slots 9 and 10 have low-lying dll's (or some other resource). I suspect that what happens is that sygic loads a resource that is even lower, and maybe it crunches into slot 2 (filesys.exe) or the process in 15. The other possibility is that sygic creates really large heaps when it's doing big calculations (>250 km), and then the memory grows up in that slot to the level where those lower lying dll's are in slots 9 and 10. Even though those dll's (if that's what they are, and not some type of static resource) may not load into the sygic slot, the memory manager still accounts for them in all of the VM slots, so they will limit how big the heaps can grow in any process.
If I were you, I'd run sygic and do a VM snapshot. Also, get devhealth.exe (search on it), run it, and see what those dll's are in slots 9 and 10. They may be the issue. Mainly, see if their shared or static (like a .plg file in tcpmp). Of course, I could be totallly wrong about this, lol.

Farmer Ted said:
So, you don't have sygic running in that one? Slot 15 is pretty porky; what process is that? You need to scroll left and right to see the processes for each slot. You may need to run vol d-pad to do that on the HD, though. Slots 9 and 10 have low-lying dll's (or some other resource). I suspect that what happens is that sygic loads a resource that is even lower, and maybe it crunches into slot 2 (filesys.exe) or the process in 15. The other possibility is that sygic creates really large heaps when it's doing big calculations (>250 km), and then the memory grows up in that slot to the level where those lower lying dll's are in slots 9 and 10. Even though those dll's (if that's what they are, and not some type of static resource) may not load into the sygic slot, the memory manager still accounts for them in all of the VM slots, so they will limit how big the heaps can grow in any process.
If I were you, I'd run sygic and do a VM snapshot. Also, get devhealth.exe (search on it), run it, and see what those dll's are in slots 9 and 10. They may be the issue. Mainly, see if their shared or static (like a .plg file in tcpmp). Of course, I could be totallly wrong about this, lol.
Click to expand...
Click to collapse
muchias gracias for youre help farmer ted
i opend up that virtual memory again and changed to different things
then i opend sygic and took a snapshot again
as you can see its going into slot 14 and every time i took a snapshot the bar went up showing more green(green means in use?)
i just looked up that slot without sygic and it tells me its the slot of tmail.exe
dont think tmail does much in that slot or its a big thing
also on the end i have all those empty slots cant it be reasignd to a new slot so it has a full bar(see the screenshot with sygic calculating a route)
will also try the program you mentioned when i get back from doing my things today as i have some appointments
edit: see you also asked what slot 15 is when i look it up it tells me its manilla.exe and im running sense2.5 from leo 3.04 so it could be heavy

Well, that's it, then. It sounds like sygic has a massive memory leak, if the heap size keeps growing. And this just confirms what I've known since the first day I got my Fuze: Manila sucks, lol.
I'm not sure why the slot 9 and 10 dll's are loaded so low. What processes are those? Maybe something in startup is causing it, and can be fixed.

Farmer Ted said:
Well, that's it, then. It sounds like sygic has a massive memory leak, if the heap size keeps growing. And this just confirms what I've known since the first day I got my Fuze: Manila sucks, lol.
I'm not sure why the slot 9 and 10 dll's are loaded so low. What processes are those? Maybe something in startup is causing it, and can be fixed.
Click to expand...
Click to collapse
thank god inever uused sygic then as it seems a stupid deep going problem
as for manilla sucks im not sure about it
the hd is my first htc device and i think the experience is nice(better then all samsungs i had
for the slots i will write them all down maybe thats easier then asking what is this and what is that(check code box below)
further when i look at windows/startup i have three things there
htc startup, pkg, and poutlook
the htcstartup also has a speaker infront of it with a x behind the speaker(hope you get what i mean)
Code:
slot1: rom dlls
slot2: filesys.exe
slot3: cprog.exe
slot4: backportrait.exe
slot5: device.exe
slot6: gwes.exe(this is a colorfull rom so i can imagine its a little high:p)
slot7: shell32.exe
slot8: virtualmemory.exe
slot9: fexplore.exe
slot10: services.exe
slot11: connmgr.exe
slot12: repllog.exe
slot13: empty
slot14: tmail.exe(sygic will be loaded in this one)
slot15: manilla.exe
slot16: jblenddaemon.exe(have read this can turned off from startup to save a little ram what do you think about that?)
slot17: commmanager.exe
slot18: empty
slot19: empty
slot20: sapsettings
the rest are all empty

I would say remove jblenddaemon.exe; it must be a java app? If you don't use java, there's no reason to have it running. You might sapsettings.exe from startup as well, if you're not using it at all. I removed it a long time ago, but I don't use bluetooth much, and when I do, it works fine without sapsettings. I think I read that it's for connecting to you car or something for hands free.
It's weird that you have the lower lying dll's (if I'm seeing what I think I'm seeing in slots 9 and 10). They definitely seem to be the wall that driver.exe is running into. I also don't know what's up with fexplore.exe. It's using a lot of VM. Is that the extended file explorer? Last time I used it, it would eat a lot of ram if you highlight pics and it showed the previews.

Farmer Ted said:
I would say remove jblenddaemon.exe; it must be a java app? If you don't use java, there's no reason to have it running. You might sapsettings.exe from startup as well, if you're not using it at all. I removed it a long time ago, but I don't use bluetooth much, and when I do, it works fine without sapsettings. I think I read that it's for connecting to you car or something for hands free.
It's weird that you have the lower lying dll's (if I'm seeing what I think I'm seeing in slots 9 and 10). They definitely seem to be the wall that driver.exe is running into. I also don't know what's up with fexplore.exe. It's using a lot of VM. Is that the extended file explorer? Last time I used it, it would eat a lot of ram if you highlight pics and it showed the previews.
Click to expand...
Click to collapse
thanks for the quick overview
the jblenddeamon is the java app
i personally never used it but there are some people using my rom who do use it:-o
guess it will be activated when they start up jblend
im gonna build a rom with jblend and the sapsettings taken out of the bootlauncher and gonna try it again to see what happens
also the file explorer is the normal fexplorer from the 21911 sys
it looks to me the verry same as every other file explorer i have seen on other roms so no preview of pictures you think i need a different fexlorer.exe?
and if so can you recommend one

I was just wondering if you were using the extended file explorer (2.06, I think; by Houming). It's pretty cool, but I personally use total commander and almost never use file explorer, so I don't use the extended on anymore, either. I was never able to make a package with it that worked, so I just did a cab install during customization. The cab is kind of weird, and I can't say I understand how it works. It actually loads up two file explorers (should have remembered that, and known yours wasn't the extended one). I attached the cab for 2.06-I packed this one, and it's compressed and doesn't have the uninstall crap loaded into it.
Sapsettings just doesn't seem to do anything. It doesn't use much memory, but you get quicker boot times when you take stuff like that out of the queue. If anyone really needs it to run, you can just give them a shortcut. You can always just remover the registry keys from your own device after a flash.

Farmer Ted said:
I was just wondering if you were using the extended file explorer (2.06, I think; by Houming). It's pretty cool, but I personally use total commander and almost never use file explorer, so I don't use the extended on anymore, either. I was never able to make a package with it that worked, so I just did a cab install during customization. The cab is kind of weird, and I can't say I understand how it works. It actually loads up two file explorers (should have remembered that, and known yours wasn't the extended one). I attached the cab for 2.06-I packed this one, and it's compressed and doesn't have the uninstall crap loaded into it.
Sapsettings just doesn't seem to do anything. It doesn't use much memory, but you get quicker boot times when you take stuff like that out of the queue. If anyone really needs it to run, you can just give them a shortcut. You can always just remover the registry keys from your own device after a flash.
Click to expand...
Click to collapse
just a quick update as im in a hurry
need to go away to arrange some things for my house in 15 min and i still need to shower:-o
i made a rom without those two thins and damn the rom has bacome faster
also the virtualmemory looks a lot emptier:-o
will post screenshot later today when im finished arranging things
also tried sygic and it managed to calculate alot further but still missing 200 km of the route i want it to be calculated:-o
do you know the differnece between poutlook and tmail.exe?
maybe i can take one of those two out

I'm not really sure what the difference is, to be honest. I don't run either at startup. I don't text much and almost never email, but regardless, you can still do it w/o any issues. I guess maybe outlook loads quicker with one or the other running. I run 11 processes at startup:
nk.exe
filesys.exe
device.exe
gwes.exe
services.exe
shell32.exe
connmgr.exe
cprog.exe
AEBPlus.exe (AE Button)
SpeedBmonitor.exe (Speed Booster; sort of helps, doesn't use much memory)
XHook.exe (XTask task manager)
I also have a shortcut that runs at startup to expand the file dialogue and another to activate resco keyboard, but those processes only run a few seconds each.
That's just 11 processes; the first 6 are mandatory, the next 2 are needed for most things (although you can kill them for maybe a little better performance gaming or something like that-you definitely don't need cprog on an airplane), and the latter 3 are just apps that I run/use all the time. I don't miss any of the other processes, and with fewer processes going, you get faster boot times. My fuze usually boots in 60-65 seconds, which is pretty nice.

well used the rom for a day now as i flashed it yesterday evening before i went to bed
the strangest thing is jblend has activated itself:-o
wonder what triggerd it to get activated as i havent opend java:S
i only used messenegr a little today but its windows its own messenger so i dont think its java related:S
you have any idea what could have opend the jblend?
also the order of what is where has changed but i dont think that does matter as i think all slots are equal of size or have they different sizes?
i will also post a screenshot of the new virtual memory but with jblend in it and sygic gets loaded in that one when i start it up:S
im totally starting to hate this program
you think the screenshots looks better now on how everything is managed?
also i read somewhere if i format my memorycard with bigger clusters it will become faster
what do you think about that?
could this speed up route calculating as the maps or on my sd card
also i will try to remove some more from the startup and hopefully this will give me better sygic calculating things
again thansk or helping em with this probblem as i think i cant solve this alone
Code:
slot1: rom dlls
slot2: filesys.exe
slot3: backportrait.exe
slot4: virtualmemory.exe
slot5: device.exe
slot6: gwes.exe
slot7: shell32
slot8: fexplore.exe
slot9: manila.exe
slot10: services.exe
slot11: connmgr.exe
slot12: cprog.exe
slot13: poutlook.exe
slot14: tmail.exe
slot15: commmanager.exe
slot16: jblendeamon.exe
the rest are all empty

I would check the jblend package and make sure there's not a reg key that's starting it up in the .reg file. The order of processes in the slots depends on the order that the processes are booted up. You can get some processes in an early slot just because there's some transient processes initiated during bootup that only run briefly, then close, which re-opens the slot for the next process in line. If you kill cprog, then start another app, it will go into cprog's slot, so then if you restart cprog, it will be in slot 13 or something like that.
Larger cluster sizes definitely speed up an sd card; I have a 16 g card, which normally had 32 kb clusters. I lowered it once to 4 kb clusters, which freed up maybe 100 mb of memory, but scanning the card became nearly impossible. Normally, if I run scandisk (I do it daily), it takes 5 min. But it would take 40 min or so with the smaller cluster size. Also, benchmarking showed that writing to the card was a lot slower (reading too, I think).
You still seem to have some low lying dll's in slots 9 and 10, which is weird.