TES5Edit Mod Cleaning Tutorial

From the CreationKit Wiki
Revision as of 17:07, 18 April 2015 by imported>WinsomeMinotaur (→‎Checking step first)
Jump to navigation Jump to search


This tutorial is designed to teach modders and mod users how to use TES5Edit to clean mods. Cleaning mods is critical to the development of compatibility in the modding community and for creating a stable modded game environment, but TES5Edit is not a simple utility and care must be taken not to damage the mods in the process. This tutorial should help explain everything that you need to know to clean mods correctly.

I will be using Sharlikran_Map_Markers_Expanded.esp. This file allows me to demonstrate the use of the program and to take pictures of the working process without using anyone's mod as a guinea pig.

Having the mod ready

Before you launch TES5Edit, be sure to have the ESP you want to clean already placed in the Data folder. If not, then before launching the program, first copy one. For the sake of this example, I'll copy my plugin to the Data folder:

Selected Mod Before Cleaning

Take notice of its size so you can see the effect of the cleaning afterwards.

The cleaning process

Quick List of What & What Not to Clean

  • Do NOT clean Skyrim.esm!
  • Do NOT clean the Unofficial Patches (USKP, UDGP, UHFP, UDBP). They have already been cleaned.
  • You should clean the official DLC. (Update.esm, Dawnguard.esm, HearthFires.esm, Dragonborn.esm)
  • You can also clean just about everything else.

Warming up

Ok, now launch TES5Edit.

The first window that opens asks you which mods to load:

TES5Edit Plugin List

In order to use this tool to clean, you should load only the mod you are cleaning and any other mods that the mod you are cleaning depends upon. Generally, this means you will only tick the specific mod you are cleaning but if the mod modifies another mod, that mod is required to be ticked as well. The tool will also load Skyrim.esm, since all master plugins are also loaded, and every mod depends on it.

So, to proceed, first deselect all the mods already checked (defined by the mods you have currently active). In order to do so quickly, right click on the window and then choose “Select None”

Select None Popup

Lastly, search for the mod you want to clean (you already copied it to the Data folder, right? If you didn't, then this is a good time to do so ... and restart TES5Edit in order to be able to see it in the list)

Then select it (tick the check to the left of the window), and click the OK button.

Selecting The Mod

After that, let the program load the stuff it needs, and when it's done, it will say so. So don't bother it until it shows "Background Loader: finished" on the Message tab.

Loading Finished

In the picture we can see the original mod content, yet untouched and unfiltered:

Before Cleaning

Checking step first

The next step is only needed if you want to see if the mod has dirty records prior to cleaning it, so you can see what will be removed. It has no impact on the cleaning process. If you're not interested in checking, just skip to the next section Finally cleaning the mod.

Ok, then. Here's the way to do that: Right click on the left pane of the TES5Edit window, and in the popup menu choose Apply Filter:

Apply Filter

In that window that opens, in order to show only the records that are ‘identical to Master’, choose the following settings:

Filter Options For Checking

You should clear all ticks on options shown as un-ticked and only tick the ones shown.

After you're done, click 'Filter' and the filtering process will start. The program will change their window caption to show the filtering progress as it goes. It could take from seconds to several minutes, depending on how large the mod is and on the speed of your computer.

When the filtering is finished the caption will return to normal and the message:

[Filtering done]  Processed Records: 889643 Elapsed Time: 00:18

will be printed on the message tab.

The point of filtering is to instruct the program to show only the things that we want to focus on, so, with these settings it will show only the records which are identical to the corresponding master record, i.e. records whose presence is not needed in the current mod, since they aren't changing anything useful. The mod only got them because the CS included them without the modder wanting to do so.

After the filtering process is done, the program will show the content below (select the root of the tree and press the '*' which is located on the numeric keypad in order to expand all levels):

Filtered Records Shown

As you can see in the image, the mod does in fact have some dirty records. They are shown colored in GREEN background and DARK GRAY text. Mainly they are landscape and some placed objects which got transferred to the mod since the CS thought that they had been touched.

None of those records are needed, since they an exact copy of the same information is already present on Skyrim.esm.

In order to be sure, you can look at the record's content. The program shows that in the right pane:

Single Record View

The picture shows the REFR record for a Placed NPC -- ThalmorEmbassyGuardNightShift02 [NPC_:000A6D6C] which is identical to the one on the master. Notice the change in text color to Dark Gray there too. But, in order to be sure about their 'equality' we can select 'Hide no conflict rows' from the popup context.

Hide No Conflict Rows

And lo and behold! Nothing is shown! Confirming the first suspicion that those records are, in fact, identical.

Nothing Is Shown!

NOTE: Deselect 'Hide no conflict rows' from the popup context.

So now, we can proceed with the cleaning.

Finally cleaning the mod

Order For Cleaning Bethesda's Master Files

TES5 Apply Filter For Cleaning Update.esm TES5 Apply Filter For Cleaning Dawnguard.esm TES5 Apply Filter For Cleaning Hearthfires.esm TES5 Apply Filter For Cleaning Dragonborn.esm

For Update.esm: Load Skyrim.esm and Update.esm, but only clean Update.esm.
For Dawnguard.esm: Load Skyrim.esm, Update.esm, and Dawnguard.esm but only clean Dawnguard.esm.
For Hearthfires.esm: Load Skyrim.esm and Hearthfires.esm but, only clean Hearthfires.esm.
For Dragonborn.esm: Load Skyrim.esm, Update.sm, and Dragonborn.esm but only clean Dragonborn.esm.

Cleaning the ESM or ESP

Again, we need to go to the filter window, so again, right clink on the left pane, but this time select "Apply Filter For Cleaning" instead:

Apply Filter For Cleaning

All of the proper options are selected automatically and the program will apply the filter (which now it takes only a few seconds, since the program has cached some of the information from the first filtering step done before) and when the filtering is finished, go to the left pane (the tree) and select the mod (in our case: Update.esm), right click on it and choose 'Remove "Identical to Master" records.'

Identical To Master

Then a warning popup will appear. Just wait a few seconds, the Yes button will be enabled, and you can click it:

Warning You Are Sure

Don't hate it! That warning is meant to prevent you accidentally changing something in a mod you didn't want to touch.

Ok, we're approaching the end of the process.

After you click "Yes, I’m absolutely sure" (because you are, right? Never lie to a program!), the removing process will be executed. After it finishes, you will notice that the modified mod turned to 'bold' as a signal that it has been modified.

And on the other side, on the message pane, a dump of what's being removed is printed:

Cleaning Log

Here I copied that blurb of text so you can examine it more closely:

[Filtering done]  Processed Records: 889643 Elapsed Time: 00:04
Removing: DA06RitualScene [SCEN:000223E7]
Removing: BardsCollegeFluteView [DLVW:00108A63]
Removing: BardsCollegeLuteView [DLVW:0010C064]
Removing: BardsCollegeDrumView [DLVW:0010C065]
Removing: MS06StyrrSpeakView [DLVW:0002850A]
Removing: GRUP Top "DLVW"
Removing: WhiterunOlavaTokenBranch [DLBR:0009CCD3]
Removing: WhiterunOlavaReadingBranch [DLBR:0009CCD4]
Removing: GRUP Top "DLBR"
Removing: DoVatsAtAll [CPTH:0003ECD5]
Removing: KillCamSlowFrontSideFarA [CPTH:000B702D]
Removing: isFrontClearL [CPTH:0010D2AD]
Removing: isFrontClearR [CPTH:0010D2AE]
Removing: S07BackRightStart01 [CPTH:0010F8AC]
Removing: S08BackLeftStart01 [CPTH:0010F8B0]
Removing: GRUP Top "LSCR"
Removing: DA02SandboxAtShrine [PACK:0004D8E2]
Removing: PowerAttackRoot [IDLE:00013384]
Removing: KillMoveShortAxeMace [IDLE:00076F44]
Removing: KillMoveShortBlade [IDLE:00076F45]
Removing: KillMoveDualWieldRoot [IDLE:000D7886]
Removing: KillMove2HMRoot [IDLE:000E1720]
Removing: KillMove2HWRoot [IDLE:000E1726]
Removing: KillMove2HWDecapBleedOut [IDLE:000E1727]
Removing: KillMove2HWDecap [IDLE:000E519C]
Removing: H2HKillMoveRoot [IDLE:000F9956]
Removing: KillMove2HWDecap00 [IDLE:00100EFB]
Removing: DBOlavaReadingMiscObjective [QUST:0002E655]
Removing: [CELL:0009F823] (in BluePalaceWingWorld "The Mind Of A Madman" [WRLD:00034240] at 1,2)
Removing: WindhelmCandlehearthHallExterior [CELL:00038382] (in WindhelmWorld "Windhelm" [WRLD:0001691D] at 32,8)
Removing: [CELL:00038381] (in WindhelmWorld "Windhelm" [WRLD:0001691D] at 32,9)
Removing: GRUP Exterior Cell Sub-Block 1, 4
Removing: GRUP Exterior Cell Block 0, 1
Removing: MS11CrimeSceneMarkerREF [REFR:00020554] (places XMarker [STAT:0000003B] in GRUP Cell Persistent Children of [CELL:0001691F] (in WindhelmWorld "Windhelm" [WRLD:0001691D] at 0,0))
Removing: GRUP Cell Persistent Children of [CELL:0001691F] (in WindhelmWorld "Windhelm" [WRLD:0001691D] at 0,0)
Removing: [CELL:0001691F] (in WindhelmWorld "Windhelm" [WRLD:0001691D] at 0,0)
Removing: WindhelmWorld "Windhelm" [WRLD:0001691D]
Removing: Mehrunes01 [CELL:00009418] (in Tamriel "Skyrim" [WRLD:0000003C] at -1,12)
Removing: GRUP Exterior Cell Sub-Block 1, -1
Removing: GRUP Exterior Cell Block 0, -1
Removing: ValtheimKeepExterior02 [CELL:000095B0] (in Tamriel "Skyrim" [WRLD:0000003C] at 18,0)
Removing: GRUP Exterior Cell Sub-Block 0, 2
Removing: GRUP Exterior Cell Block 0, 0
Removing: [ACHR:000A6D5E] (places ThalmorEmbassyGuardDayShift03 [NPC_:000A6D69] in GRUP Cell Temporary Children of ThalmorEmbassy04 "Thalmor Embassy, Barracks" [CELL:0006DAA0])
Removing: [ACHR:000A6D5F] (places ThalmorEmbassyGuardDayShift02 [NPC_:000A6D68] in GRUP Cell Temporary Children of ThalmorEmbassy04 "Thalmor Embassy, Barracks" [CELL:0006DAA0])
Removing: [ACHR:000A6D60] (places ThalmorEmbassyGuardDayShift01 [NPC_:000A6D67] in GRUP Cell Temporary Children of ThalmorEmbassy04 "Thalmor Embassy, Barracks" [CELL:0006DAA0])
Removing: [ACHR:000A6D61] (places ThalmorEmbassyGuardDayShift04 [NPC_:000A6D6A] in GRUP Cell Temporary Children of ThalmorEmbassy04 "Thalmor Embassy, Barracks" [CELL:0006DAA0])
Removing: ThalmorEmbassy02 "Thalmor Embassy, Elenwen's Solar" [CELL:0007DCFC]
Removing: GRUP Interior Cell Sub-Block 2
Removing: fVATSCameraCutAwayDistance [GMST:000142ED]
[Removing "Identical to Master" records done]  Processed Records: 963 Removed Records: 50 Elapsed Time: 00:00

On the tree pane, to the left, the mod’s content shows the records modified in a bold font:

Modified Content In The Right Pane

As you can check for yourself, the records shown are the same that were shown when first filtering. Notice the removal of the Placed NPCs when they aren't needed because they were identical.

Undelete and Disable References

Right click again on the plugin you are cleaning (again in our case: Update.esm) and select “Undelete and Disable References.” Again, check the Messages tab to see what was changed. Make a note of the number of "Identical to Master" records that were removed and the number of "undeleted and disabled references" for later when reporting the plugin to the BOSS team.

Saving the work

Ok, understand this point which is very important: the modified mod is yet unsaved and it will not be saved until you want to. If you change your mind now, you will be allowed to exit the program (just click on the top-right corner of the window as you would do normally,) and then answer to the window that appears:

Save Selection Window

In that window, you can uncheck all the mods you want (in our case it’s just only one) to preserve them untouched and they won’t be modified at all.

On the other hand, you can call the save window yourself by pressing the key combination 'Ctrl+S' (the standard save shortcut), and if you want to save them, now you can leave the checks ticked.

At this point, notice the message tab:

[00:00] Saving: Dawnguard.esm.save.2012_10_28_04_36_43
[00:00] [Dawnguard.esm] Setting Persistent: [REFR:000CCE05] (places CounterLeanMarker [FURN:0006CF36] in GRUP Cell Temporary Children of WarehouseFurniture "Warehouse Furniture" [CELL:000CCDAA])
[00:00] [Dawnguard.esm] Setting Persistent: [REFR:000CCE09] (places WallLeanMarker [FURN:00052FF5] in GRUP Cell Temporary Children of WarehouseFurniture "Warehouse Furniture" [CELL:000CCDAA])
[00:02] Done saving.

The program doesn't actually touch the original mod when saving, it always generates a new file. The name is chosen to allow a distinct file to be generated each save, and so the program does, for every change you do, you can save and you will get a distinct file and the previous one will be left untouched.

That way, in case something goes wrong. Maybe you deleted a group record forgetting that within it was some important edit. As soon as you notice it you can roll back to the previous save file, or open it as a new mod and copy the editions back. Thus, it is important to stress this point: save often, and only do edits in chunks and save every one separately. In that way, you can go back to any point you wish.

Another thing to notice is that the original mod (in this screen shot Dawnguard.esm) is left untouched until you exit the program:

Save File Location

At which point the program will rename the old original file as a 'backup' file and place that in the folder TES5Edit Backups, and the new 'save' file as the original mod. (Notice the reduction in size? Those were the extra records that are now removed.)

When we’re done and after we exit the tool:

Back Up File Location

the roles reverted, so you now can play test it directly after closing the program.

Ok, that should be everything I can think of now.

Articles about the program

Additional TES5Edit Resources

Final words

Keep in mind that we're only scratching the surface of what can be done with this awesome tool.

The modding world is better thanks to generous individuals, like ElminsterEU, who have put an enormous chunk of their personal spare time into the making of this wonderful program. All kudos should go to him. And if you are in position of doing so, don't forget to rate the download in TESNexus.

Closing Remarks & Credits

This guide has been adapted from the TES4Edit/Mod cleaning tutorial with TES4Edit.

Many thanks go to the various authors of and contributors to that article, including but not limited to: Brumbek, Aellis, Kalevala, Leeus, DragoonWraith.

Thanks also go to ElminsterEU, Sharlikran, and Zilav for their work in getting TES5Edit released.

Still to do:


Language: English  • 日本語