CWM making backups that are very small (@15mb)? - Nexus 7 Q&A, Help & Troubleshooting

Using the newest CWM recovery touch, I'm trying to make a backup before jumping to AOKP (hooray!) But.... My backups are tiny; about 15mb. I'm not sure how big they should be (the one I made immediately after rooting was 880mb) but I'm certain this is too small. Anyone have any idea what I'm doing wrong? Thanks in advance.

If you've used an older version of CWM, I'm sure you're used to ~1GB backups. In 6.0 and above, backups are handled differently. A good portion of backups are put into these "blob" files and then a smaller backup is made for each specific backup. The theory is that if you have multiple backups, they can pull data from the blob files instead of duplicating things that haven't changed. Whatever you do, DO NOT delete these blob files, doing so will corrupt your backup.

meijin3 said:
If you've used an older version of CWM, I'm sure you're used to ~1GB backups. In 6.0 and above, backups are handled differently. A good portion of backups are put into these "blob" files and then a smaller backup is made for each specific backup. The theory is that if you have multiple backups, they can pull data from the blob files instead of duplicating things that haven't changed. Whatever you do, DO NOT delete these blob files, doing so will corrupt your backup.
Click to expand...
Click to collapse
Thank you! I was so confused by this. So if I want to transfer my backup to my laptop HDD, I now need to copy the entire Clockworkmod folder? (and this will have all of the files necessary for a full backup?)

slack04 said:
So if I want to transfer my backup to my laptop HDD, I now need to copy the entire Clockworkmod folder? (and this will have all of the files necessary for a full backup?)
Click to expand...
Click to collapse
Unfortunately yes, the new blobs system means it will take a longer time to make a copy of your backup, it's horrible over Wi-Fi. I just didn't bother with it and went with TWRP instead.

Related

corrupted CWM nandroid backup? repairable?

Im trying to restore a copy of my droid x system from this AM.
but as its copying the Data portion, i get into a file that it hangs on part of "casino" a .jpg, causes the whole thing to lock up and stop responding.
Anyway I can fix this backup? I have another backup but it restores the whole data section in 2 minutes...it doesnt seem to work either (((( Help!
apparently karma is not my freind this week
my backup was cut short due to lack of space on the SD card and CWM didnt notify me
kodakeos said:
Im trying to restore a copy of my droid x system from this AM.
but as its copying the Data portion, i get into a file that it hangs on part of "casino" a .jpg, causes the whole thing to lock up and stop responding.
Anyway I can fix this backup? I have another backup but it restores the whole data section in 2 minutes...it doesnt seem to work either (((( Help!
Click to expand...
Click to collapse
Do you have any other backups you can restore to? I would recommend taking a backup of where you are at right now, even though you obviously want to restore to an earlier point.
If all of your backups are having the same issue, you may have a corrupt SDcard or a corrupt file that is sitting in your /data partition. This is not a definite, so don't freak out, but if you see the same result with many/all backups, I would look into this.
If you can deal with wiping your /data partition... I would take a backup of your current setup, then wipe /data... Then try restoring that backup... If it works, then I would be inclined to believe that one jpeg file may be corrupt, and is causing problems for any backup that has that file in there...
This is just a speculation from the info you have provided and around 6 years of IT work....
EDIT: NEVERMIND! It looks like you posted again while I was typing up my guess, looks like I was off! LoL
yea i was basically able to salvage most of it between the system of one, with the data of another. so im about 75% back to where i was.
obviously i need to either a: keep less stuff on my SD card, or B: use my spare 2gb card for backups...
One thing you may want to try if you are running out of space from lots of Clocwork backups...
Create a folder on your PC/Mac and copy off the folders in the yyyy-mm-dd-hh-mm format and copy your backups from your SDcard onto your computer. Then you could delete them off of your sdcard. When I started making a lot of backups I was running out of room and copied some off. Then I deleted them off my sdcard. I have tested moving them back on, and restoring one that was on my PC, and didn't have any issues!
Just a thought...

[Q] Advice on how to manage nandroids and app backups

So I am not even a week into rooting my Evo and flashing roms and I am not sure what the best way to organize my backups are.
What do you guys do to manage all the nandroids and app backups in Titanium?
Here is my situation, I have my nandroids from right after rooting and a few from doing the two updates that CM7 had. I first did a nandroid or two using CWM, I then flashed recovery to Amon_Ra and did nandroids in their also. I also had all my apps backed up using TB post-root (sense) and now that I am on CM7 I have many different apps that I have added. I have read some people say not to backup apps from 2.2 on sense to CM7, though the few that I have done work fine.
Should I delete all the backups in TB from my stock 2.2 w sense? Can I rename my RA nandroid backup files so that I can label them better to know what they are? Or should I just move them to my computer and put them in a folder named what they are and leave the file name alone? Can I move the backup folder from TB onto my computer that has my sense backups to save for a rainy day?
I can see this getting very messy and confusing if I do not get a handle on all these backup files. Just wondering if someone has a good system for keeping track of these and when to get rid of nandroids and app backups.
Thanks!!!!
i just created folders named clock and amon ra on my computer, and inside those folders i created folders with the names of the roms i flashed with each recovery and then i moved the nandroid files from my sd card into the computer folders that corresponded, and i only left my last working backup on my phone
- clear your TB and start fresh. i would advise against trying to criss cross your Sense/AOSP backups. it may work but i'd consider it a fluke not the rule.
- you cannot restore a RA nandroid with CWM nandroid and viseversa. so whichever one you think you'll stick with...you can get rid of the others.
- yes, you can rename the nandriod folder. no spaces. very handy once you get a few nandroids going.
- i use SyncToy from Microsoft to copy all the sdcard data onto my pc. this way i can protect my nandroids, pics, vids, mp3, misc crap.
i normally leave one or two nandriods on my device (i have had a bad nandroid in the past) and zip of the current rom.
as for the deletion policy..that depends on your level of paranoia and amount of available diskspace and time.
DraginMagik said:
- clear your TB and start fresh. i would advise against trying to criss cross your Sense/AOSP backups. it may work but i'd consider it a fluke not the rule.
- you cannot restore a RA nandroid with CWM nandroid and viseversa. so whichever one you think you'll stick with...you can get rid of the others.
- yes, you can rename the nandriod folder. no spaces. very handy once you get a few nandroids going.
- i use SyncToy from Microsoft to copy all the sdcard data onto my pc. this way i can protect my nandroids, pics, vids, mp3, misc crap.
i normally leave one or two nandriods on my device (i have had a bad nandroid in the past) and zip of the current rom.
as for the deletion policy..that depends on your level of paranoia and amount of available diskspace and time.
Click to expand...
Click to collapse
Thanks, I like the idea of clearing out TB (I just did it) I was just worried removing the files would somehow mess up the TB app.
Sticking with Amon RA and I knew about not being able to use nandroids from different recoveries.
I will checkout synctoy, sounds cool, I already have three folders of my entire SD card that I made during my rooting process and changing recovery process. I hate it, I don't know what I need to keep from them.
Thanks for the input

How to backup with nandroid if there is not enough space?

Hello,
I wonder if anyone know... What happens when let's say i have 9gb of data on my s2 and i want to backup it with nandroid? It should be possible to do this to sd card, but what if some apps are on phone and some on sd card? How backup then?
If i upgrade to a newer custom built rom, i them try to backup, wouldn't it restore the older backed up firmware? Or just apps and settings, but not rom itself?
Thank you,
Tomas
no one? did no one fill their phone and tried to backup? maybe there is a solution to backup to a computer?
execine said:
Hello,
I wonder if anyone know... What happens when let's say i have 9gb of data on my s2 and i want to backup it with nandroid? It should be possible to do this to sd card, but what if some apps are on phone and some on sd card? How backup then?
If i upgrade to a newer custom built rom, i them try to backup, wouldn't it restore the older backed up firmware? Or just apps and settings, but not rom itself?
Thank you,
Tomas
Click to expand...
Click to collapse
Nandroid backups are an image of
/system
/data
/dbdata
(on CF-Root, not sure about original CWM) it also includes .android_secure, which is SD-stored apps.
I don't understand what you are asking.
If there is not enough space you obviously have to delete something.
BTW: data-partition is around 2,1GB and system-partition 500MB, so there is no way a single backup can use 9GB
Maybe I am not being very clear, sorry about that
Coming from an Iphone, i am looking for a total phone backup solution. Itunes backs up literally everything - your apps, music, photos etc. It's filled probably with 20gb of different data.
Question is if I have my phone filled with games, different apps which make let's say 10 gb (not that much counting in that one game may be up to 1 gb), so how do i backup this? To SD card?
What if I have 20gb of data , 10 of which are on phone, 10 on sd card, in this case i wouldn't be able to backup everything?
One more technical question about rom upgrades. Currently i installed Villain Rom and have a backup made with nandroid. When i upgrade to a newer Villain Rom 1.5 or whatever comes out and I do the restore, i suppose it will restore 1.4 rom version with it's all apps and settings?
In this case, how do i backup only accounts, contacts, sms , apps, photogallery but not rom itself?
Sorry for all those questions, but i'm reading the forum all over, and there's still hundreds of questions i'm looking to find answers, so that i could comfortably migrate from iphone to galaxy..
execine said:
Maybe I am not being very clear, sorry about that
Coming from an Iphone, i am looking for a total phone backup solution. Itunes backs up literally everything - your apps, music, photos etc. It's filled probably with 20gb of different data.
Question is if I have my phone filled with games, different apps which make let's say 10 gb (not that much counting in that one game may be up to 1 gb), so how do i backup this? To SD card?
What if I have 20gb of data , 10 of which are on phone, 10 on sd card, in this case i wouldn't be able to backup everything?
One more technical question about rom upgrades. Currently i installed Villain Rom and have a backup made with nandroid. When i upgrade to a newer Villain Rom 1.5 or whatever comes out and I do the restore, i suppose it will restore 1.4 rom version with it's all apps and settings?
In this case, how do i backup only accounts, contacts, sms , apps, photogallery but not rom itself?
Sorry for all those questions, but i'm reading the forum all over, and there's still hundreds of questions i'm looking to find answers, so that i could comfortably migrate from iphone to galaxy..
Click to expand...
Click to collapse
Regarding restoring only apps/accounts/etc but not the rom iteself, within cwm, in backup and restore, chhoose advanced restore and the restore data.
Im not certain whether it restores gallery or sms.i sync my photos via dropbox, and backup my texts seperately.
Sent from my GT-P1000 using XDA Premium App
So there is no unified backup solution for android? You would have to back up everything separately ?
execine said:
So there is no unified backup solution for android? You would have to back up everything separately ?
Click to expand...
Click to collapse
It's fairly simple:
Nandroid for your ROM and user data that is on the PHONE and /data partition
For the /sdcard and /sdcard/external_sd, that's up to you to sort out... Perhaps back up the contents by connecting to your PC? Then copy the contents of the SD? That way you have your nandroid backup stored on the computer just in case
so then in case something goes wrong, i restore with nandroid and manually copy contents from PC and ALL of my phone's data (software, contacts, gallery etc) will be there?
execine said:
Coming from an Iphone, i am looking for a total phone backup solution. Itunes backs up literally everything - your apps, music, photos etc. It's filled probably with 20gb of different data.
Click to expand...
Click to collapse
Well, now you have a phone that doesn´t hide everything from the user it shouldn´t be that hard to make a backup.
There are basically 4 interesting partitions on the phone:
system (about 500MB) - This holds more or less the whole Firmware. While it is technically just a partition on the flash-memory, it is used like a ROM in normal usage, so the only situation where something will be written on this partition is a firmware-upgrade.
data (about 2GB)- This partition holds all user-installed apps and their settings.
sdcard (about 12GB) - This is not really a sdcard. Instead it is a part of the internal memory, you can use it for example for media, documents, images etc., whatever you like. This partition can be accessed on your computer as a regular USB-storage, and you can do a backup of it the way you like, either simply copying everything, or using a backup-solution of your choice.
external_sd (optional) - This is the micro-sd-card you can put in your phone. Obviously you can use it for anything you like. This partition is also accessible as a USB-storage or you can use a simple USB card-reader to access it on your computer.
Usually all your applications and settings will be stored in the /data/-partition.
If you choose the Move-to-SD option in the application-manager, some parts of the application will be moved to the (internal) /sdcard/-partition, but all the user-data/settings still remain on the /data/-partition.
So the maximum space you need to backup all your settings and apps is under 3GB.
Now to the possibilities of a backup, and the importance of the different things.
A nandroid-backup will basically make an image of the /system/ and /data/ partitions (also a bit more, but that´s not really important).
Usually it will use the /sdcard/-partition, which actually is still in your phone.
If you restore a Nandroid-Backup your System will be in the exact state before the backup, including all applications with their settings (which also means contacts, e-mails, sms etc).
Obviously everything that has changed after the backup will be lost.
A restore well also restore the complete firmware from the backup.
A backup from Nandroid can only be restored on the same phone, with the same partitions.
The second possibility to make backups would be TitaniumBackup.
This program will store all your installed applications and their data.
Default it will store it on the internal /sdcard/, but it is probably more useful to change the path to the external_sd.
Everything in Android is an application, so this will also save all your settings.
During a restore TitaniumBackup simply reinstalls your applications and then restores their settings.
TitaniumBackup can restore your applications with any Firmware, and in theory even on other phones (it may not work with special System-apps but it surely works with most "user-apps")
So Clockworkmod is great if you want to play around with different firmwares, especially Custom ROMs.
You can install different ROMs, make a backup and very easy and fast switch between them.
For a "regular" backup TitaniumBackup is maybe the better choice, it can backup all your settings and applications and for example if a Firmware-update goes wrong simply restore anything.
There is no real need to backup the /system/-partition anyway, you can simply download the Firmware and flash it, there is no user-data on this partition.
sdcard and external_sd usually only contains media, which you probably have somewhere on your PC anyway, so there is no real need for a backup, maybe for the pictures and videos you make with your phone, but again you should copy this on your PC regularly anyway. And if you want you can easily copy everything on it as well.
What if I have 20gb of data , 10 of which are on phone, 10 on sd card, in this case i wouldn't be able to backup everything?
Click to expand...
Click to collapse
Question is if I have my phone filled with games, different apps which make let's say 10 gb (not that much counting in that one game may be up to 1 gb), so how do i backup this? To SD card?[/quote]
Apps can´t be several GB in size on Android. Normally you have only around 2GB for Apps, if you use the App2SD-feature it can be expanded a bit.
If applications need a lot of data, for example like navigation-programs or games, they will download this on the first start and store this on the /sdcard/-partition.
As I said, you can access this easily like a removable drive and copy everything you like.
It isn´t also that important to make a backup of this, as it can be downloaded again anytime, and if something goes wrong it usually will mess up your system and don´t influence the data-partition anyway (well as long as you don´t repartition the whole memory)
Thank you, that does explain a lot!
I connected my S2, but i can't see to find any installed apps browsing through USB, or i shouldn't be seeing that?
Tomas
execine said:
Thank you, that does explain a lot!
I connected my S2, but i can't see to find any installed apps browsing through USB, or i shouldn't be seeing that?
Tomas
Click to expand...
Click to collapse
No, they are stored in /data
You back that up using nandroid, then you restore it via nandroid and they will be there. What you see on your PC via USB is the "internal SD".
Understood, thank you. Things getting more clear after a week of reading and using the phone ))
Sent from my GT-I9100 using Tapatalk
execine said:
I connected my S2, but i can't see to find any installed apps browsing through USB, or i shouldn't be seeing that?
Click to expand...
Click to collapse
No, you see the (internal) /sdcard/ partition and (if present) the /external_sd/ (the MicroSD-card you have in your phone)
To simply backup your applications, the easiest way is TitaniumBackup.
This will store the .apk and settings for each up in a folder of your choice (on /sdcard/ or /external_sd/, as you usually have no direct access to the other partitions)
You can copy this folder on your PC, or even in the TitaniumBackup-folder of another phone and use it there.
There are several advantages using TitaniumBackup to save your Apps over CWM-recovery. You can use it with the enabled phone for example, and also just restore individual Apps, if you like.

Extract TWRP backup for photos?

So the other day I restored my rooted phone back to stock everything and unrooted. I thought my photos were saved to my SD card so I didn't think about saving anything when I restored. But yesterday I went to upload a photo and they were all gone! Luckily I made a twrp backup before I restored but I have no idea how to find my photos in the backup. Can anybody help?
Hate to be the bearer of bad news but a twrp nandroid is not going to contain your photos. They're on a part of the sd card a nandroid doesn't backup. Did you have them backed up on Dropbox of anything?
jd1639 said:
Hate to be the bearer of bad news but a twrp nandroid is not going to contain your photos. They're on a part of the sd card a nandroid doesn't backup. Did you have them backed up on Dropbox of anything?
Click to expand...
Click to collapse
I didn't have them saved anywhere.. Is there a tool that will allow me to still view the data from the saves?
white.noise said:
I didn't have them saved anywhere.. Is there a tool that will allow me to still view the data from the saves?
Click to expand...
Click to collapse
You had them on your internal? Idk of any tool that can recover them. Someone very familiar with adb may be able to help on how to access the sd card but it won't be easy. There are, expensive, services that can recover them but they'd have to be very important to you.
In the future, set up Dropbox. It's free for a fair amount of storage and it's automatic. Take a pic and it'll upload.
TWRP does not backup photos in DCIM folder in internal memory
jd1639 said:
Hate to be the bearer of bad news but a twrp nandroid is not going to contain your photos. They're on a part of the sd card a nandroid doesn't backup. Did you have them backed up on Dropbox of anything?
Click to expand...
Click to collapse
Thanks jd. I found this thread because I was doing a search for what TWRP actually backs up. I did a search as I also had noticed that no photos show up in the DCIM folder after a TWRP 'restore' operation, which looked like TWRP doesn't backup photos contained in the internal DCIM folder. This came as a bit of a surprise to me, and was wondering if something prevents TWRP from backing up the photos.
TWRP is definitely a very good backup utility, but I think that some kind of pop-up message (with a don't show again checkbox option) would be nice to warn users that TWRP doesn't backup the DCIM photos. I'm thinking that if the utility has the option to backup data + system + boot, then it should backup the valuable user data - which includes photos in internal memory (- that would be expected).
I'm running stock rooted ICS ROM, and I use TWRP to backup data+boot+system, and I also use KIES to do a backup as well. The TWRP restore gets all the apps back (and most things), and the KIES restore gets back the photos. A nice combo.
kennyTSV said:
Thanks jd. I found this thread because I was doing a search for what TWRP actually backs up. I did a search as I also had noticed that no photos show up in the DCIM folder after a TWRP 'restore' operation, which looked like TWRP doesn't backup photos contained in the internal DCIM folder. This came as a bit of a surprise to me, and was wondering if something prevents TWRP from backing up the photos.
TWRP is definitely a very good backup utility, but I think that some kind of pop-up message (with a don't show again checkbox option) would be nice to warn users that TWRP doesn't backup the DCIM photos. I'm thinking that if the utility has the option to backup data + system + boot, then it should backup the valuable user data - which includes photos in internal memory (- that would be expected).
I'm running stock rooted ICS ROM, and I use TWRP to backup data+boot+system, and I also use KIES to do a backup as well. The TWRP restore gets all the apps back (and most things), and the KIES restore gets back the photos. A nice combo.
Click to expand...
Click to collapse
I think it makes sense to not back up the internal user storage. It's the same way it wouldn't back up an external SD, and plus then if it tried to back up all of it then it would add a few more gigs to the backup size and it probably wouldn't fit for many people. Not to mention that making a backup of something on itself is not the greatest idea in the first place (all the others are at least backups of different partitions). Makes more sense to just regularly pull off files to PC before doing flashing and modifying.
DeadlySin9 said:
I think it makes sense to not back up the internal user storage. It's the same way it wouldn't back up an external SD, and plus then if it tried to back up all of it then it would add a few more gigs to the backup size and it probably wouldn't fit for many people. Not to mention that making a backup of something on itself is not the greatest idea in the first place (all the others are at least backups of different partitions). Makes more sense to just regularly pull off files to PC before doing flashing and modifying.
Click to expand...
Click to collapse
Thanks deadlysin. I know where you're coming from there....know what you mean. I don't mind it if TWRP doesn't backup all user data in internal memory after now having understood what TWRP defines as 'data' in it's 'DATA + system + boot' backup. I now use a combo of TWRP and KIES for backing up. The TWRP does a nice job of preserving most things - apps, call logs, contacts, messages etc, and KIES does the photos, as well as contacts and messages (but KIES seems to have a problem with backing up call logs, but TWRP can handle call logs which is great).
I fully understand the extra memory that a TWRP backup would take (in some cases) if TWRP did have an option for backing up the internal storage DCIM data too. But I reckon that it would be terrific to have such an option where 'data + system + boot' creates a complete image of internal storage information. The reason for this is because I was looking for a utility that would provide a fairly 'complete' one-shot backup of the user environment (photos, logs, messages, contacts, apps etc etc). But for TWRP, it looks like the definition of 'data' at the moment is 'data MINUS photos and possibly some other internal storage things'. This is ok though - since the most important thing is to just understand which user/personal data is not included in a TWRP 'data + system + boot' backup. On the net, I saw a TWRP page that had contents saying 'what to back up?', and on that page, I think that adding extra information like 'which user information/data does TWRP NOT backup?' would be handy. Anyway, the TWRP software is really good. Highly recommended.
kennyTSV said:
I did a search as I also had noticed that no photos show up in the DCIM folder after a TWRP 'restore' operation, which looked like TWRP doesn't backup photos contained in the internal DCIM folder. This came as a bit of a surprise to me, and was wondering if something prevents TWRP from backing up the photos.
Click to expand...
Click to collapse
Same problem with CWM, no photos in the backup. I also thought first that something was preventing CWM to backup everything. And everywhere it reads that this backup would be a nandroid backup and therefore an exact copy of the contents. So this obviously is not correct - looks like a lot of people are copying statements without knowing or proofing.
The folder /sdcard/0 (which actually is /data/media ) is the part which you are allowed to see without root permissions and here is all the data like photos, media, downloads and so on which you created or copied there.
THIS is the way to get this important folder - at least it worked with CWM 6.0.4.7:
Enter recovery mode. Connect Phone to PC. ADB should be already installed. Create an empty folder and change directory to there within command shell. Type in
adb pull /sdcard/0
and voilá, you will have a copy of all the missed data.

[Q] why my storage space is vanished?

Using GS4 I9505, and my internal storage is getting shorter shorter, day by day. almost like its vanished. i've check emulated 0 and legacy drives nothing there. but as i gethered it coz of CWM, now using twrp, uninstalled CWM but still storage isn't available for usage.
Your space is still lost because it's still allocated to CWM for nandroid backups, even though you no longer have CWM on the device. Therefore, you need to put CWM back on the device, go into its backups and storage menu, delete any existing backups it made, then free the allocated space.
When you put TWRP back on to the S4, your space should return.
He can delete the CMW folder from the storage. The backups are there and they are not hidden.
I provided an in-depth explanation of this in an earlier thread on the same topic, but in essence CWM protects the nandroid backups space so nothing else can write to that area. This is because CWM performs incremental backups by default, and deleting older restore points messes up all of them. The protection persists even after CWM is removed, so when switching recoveries, all backups need to be deleted in CWM, and all allocated space freed using the "free allocated space" option in the backup and restore menu.
EDIT: To point out the obvious, there would be no need for a "free allocated space" option in CWM if the space weren't protected.
Well, that's stupid. With TWRP I can simply go inside the folder and delete the backups (without the need of booting into recovery and deleting them from there).
Calling it stupid is a bit harsh, and besides, Koush probably will disagree with you.
By default CWM is set to do incremental backups and does this as a space-saving feature. For example purposes let's say a nandroid backup is 2GB. Using the standard .TAR method four nandroid backups would take up 8GB. Switch to .DUP and those same four backups may only take 3GB. This is because .DUP only backs up the files that have changed between the current system and the previous backups, rather than backing up the entire partition. Since CWM in .DUP doesn't back up the entire partition when making its backups, it's vitally important that the backups be protected. Otherwise, deleting an older backup makes it impossible to restore any later backups.
The example I used in my other discussion to illustrate this was four backups, labeled A through D. A is the master backup and B through D are the incremental backups. If the space wasn't protected, deleting backup C in a file manager would render backup D invalid because of missing files. Naturally, deleting backup A would render all subsequent backups invalid, as it is the master backup.
In CWM it is possible to switch from .DUP to .TAR and thus stop CWM from allocating space for backups. The OP didn't do that, which is why his space disappeared even after switching to TWRP. There may be a manual method of removing the allocation through a terminal, but it's simply easier to restore CWM, delete the backups, free the space, then switch back to TWRP.

Categories

Resources