[Mangos One] git cloned latest (June-04-2016) and ExtractResources.sh doesn't extract everything

scaredy_cat · June 4, 2016

Running ubuntu 16.04 with an apt-get of everything needed to compile. Compiles and installs as it should. Copy over game client and extract dbc/maps/vmaps/mmaps. End up with 39 locations for maps. If I did this on Windows (I tried it for sake of just copying the maps from there) and it has upwards of 89 locations. When I move the stuff over to the bin folder and run mangosd, mangosd reports that maps missing, everything in the 5xxxxxx.map range isn't there. On Windows, they are. I extracted them on Windows and copied them to the bin folder but am told by mangosd that the maps are incompatible with what I'm running. Even though the two things are the same version (least I imagine they are). Last map extracted is 4694735.map.

I don't know what else to do, is there something I should put in the server/src/tools/Extractor_projects/map-extractor/System.cpp file for the map-extractor to see the other MPQs? I did have this client attach to a cmangos server and everything worked so I am inclined to believe that it isn't an incomplete version of the game. And the client is updated to 2.4.3 and detected as such.

Thanks again for reading and any input is much appreciated.

edit: I had cloned develop21 braches. That is what I wanted and thats what I ended up with. Solution in posts #3 and #4.

Talendrys · December 1, 2016

Hello,

I'm sorry we couldn't find a solution for you this time. why don't you give a try to develop21 branch which contains all the latest features (and some bugs too) ?

extralismizer · June 20, 2016

Oops, I just realized, that I didn't post the right logfile. But, I can't post the MangosExtractor_detailled.log, as it is far to long (much more than 20000 letters). So I did some research on it:

- first error is:

.
.
Processing........................100%
mangos one vmap (version VMAPs05) extractor

Beginning work ....

Game path: Data/
Found locale 'deDE'

Adding data files from locale directories.
Scanning patch levels from data directory.
Scanning patch levels from locale directories.
Locale: deDE

Opening Data/deDE/locale-deDE.MPQ
Opening Data/deDE/expansion-locale-deDE.MPQ
Opening Data/common.MPQ
Error opening archive 'Data/common.MPQ': Does file really exist?
Opening Data/expansion.MPQ
Opening Data/patch.MPQ
Opening Data/patch-2.MPQ
Opening Data/deDE/patch-deDE.MPQ
Opening Data/deDE/patch-deDE-2.MPQ
.
.

- then at "Extracting World\wmo\..." i get

Extracting World\wmo\Dungeon\CavernsOfTime\CavernsofTime.wmo
No such file.
Could not open all Group file for: CavernsofTime.wmo

Same mistake for

Extracting World\wmo\Dungeon\MD_Goldmine\MD_Goldmine_hellfire_human.wmo

Extracting World\wmo\Lorderon\Undercity\Undercity.wmo

and

Extracting World\wmo\transports\zeppelin\transport_zeppelin.wmo
No such file World\wmo\transports\zeppelin\transport_zeppelin.wmo.
Couldn't open RootWmo!!!

But everything ends with: Extract wmo complete (No (fatal) errors)

- Almost every WMOInstances creates that error:

.
.
WMOInstance::WMOInstance: couldn't open ./Buildings/Test.wmo
Processing Map 13
[################################################################]
.
.

Maybe 20 were working fine, the rest didn't

- Then I got some (!!) warnings. That could be easily about 1000 lines like:

.
.
Could not find file of model World\Skillactivated\Tradeskillnodes\Tin_Miningnode_01.m2
.
.

- And the last thing which appeared strange to me is:

ERROR: Can't open raw model file: Buildings/Nightelfmoonwellornate.wmo
ERROR: Can't open raw model file: Buildings/Humanlevelonetest.wmo
ERROR: Can't open raw model file: Buildings/Stormwind.wmo
ERROR: Can't open raw model file: Buildings/Transportship_A.wmo
ERROR: Can't open raw model file: Buildings/Guardtower.wmo
ERROR: Can't open raw model file: Buildings/Orctower.wmo
ERROR: Can't open raw model file: Buildings/Md_Goldmine_1Room.wmo
ERROR: Can't open raw model file: Buildings/Holdingpenbamboo.wmo
ERROR: Can't open raw model file: Buildings/Landingpad01.wmo
ERROR: Can't open raw model file: Buildings/Transport_Zeppelin.wmo
ERROR: Can't open raw model file: Buildings/Transport_Zeppelin.wmo
ERROR: Can't open raw model file: Buildings/Giantseaturtle02.wmo
ERROR: Can't open raw model file: Buildings/Giantseaturtle01.wmo
ERROR: Can't open raw model file: Buildings/Dsnightelfmoonwellornate.wmo
ERROR: Can't open raw model file: Buildings/Kl_Onyxiaslair.wmo
ERROR: Can't open raw model file: Buildings/Blackcitadel.wmo
ERROR: Can't open raw model file: Buildings/40Manegglayerboss.wmo
ERROR: Can't open raw model file: Buildings/Humantank02.wmo
ERROR: Can't open raw model file: Buildings/Humantank01.wmo
ERROR: Can't open raw model file: Buildings/1000Needlesbridge.wmo
ERROR: Can't open raw model file: Buildings/Final_Stage.wmo
ERROR: Can't open raw model file: Buildings/Redridgechapel.wmo
ERROR: Can't open raw model file: Buildings/Duskwood_Human_Farm.wmo
ERROR: Can't open raw model file: Buildings/Griffonaviary.wmo
ERROR: Can't open raw model file: Buildings/Lumbermill.wmo
ERROR: Can't open raw model file: Buildings/Duskwoodfarmhouseburnt.wmo
ERROR: Can't open raw model file: Buildings/Duskwoodchapel.wmo
ERROR: Can't open raw model file: Buildings/Chapel.wmo
ERROR: Can't open raw model file: Buildings/Dsnightelfdruidtower.wmo
ERROR: Can't open raw model file: Buildings/Ruinedhumanguardtower01.wmo
ERROR: Can't open raw model file: Buildings/Duskwood_Humantwostory.wmo
ERROR: Can't open raw model file: Buildings/Westfallfarmhouseburnt.wmo
ERROR: Can't open raw model file: Buildings/Westfall_Human_Farm.wmo
ERROR: Can't open raw model file: Buildings/Gianttotem.wmo
ERROR: Can't open raw model file: Buildings/Bridgebigwhite.wmo
ERROR: Can't open raw model file: Buildings/40Manarmygeneral.wmo

File 'temp_gameobject_models' seems to be corrupted

Afterwards it is creating some errors, but not in that scale. Maybe, if I get to solve the "root-problem", then the rest does not occur. As my explanation may be a bit confusing, I have uploaded the logfile. I hope anyone can do anything with it and help me.

MaNGOSExtractor_detailed.txt

Olion · June 20, 2016

This part of the log is critical:

Opening Data/common.MPQ
Error opening archive 'Data/common.MPQ': Does file really exist?

Check the file existence. (There might be filesystem issue, if you use FAT32 filesystem: the file is about 3.5Gb; better use NTFS). Missing models mean enabled LoS (and movement as well) through respective gameobjects. However this is not critical to run the game.

extralismizer · June 22, 2016

The file "common.MPQ" exists at the proper location (filesystem is ext4).

I just got another - interesting - idea:

The "server" (a netbook, yes i know...) is used for a VERY PRIVATE group of only some players, so I figure the capacity should be enough to run the server (about 1GB RAM). Can it be, that my server is simply too weak to create the maps? Do you have experience with running the server on such high-end-hardware?

extralismizer · November 19, 2016

Hey guys,

sorry to dig out this old corpse, but now - finally - after some time "off" could try to extract the maps at a more powerful pc: with the same result.

So the questions remains: Why the extractor can't open the common.MPQ?

Any help would be great! I have tried to reinstal the client - with no result.

Talendrys · November 23, 2016

Are you on Windows or Linux ?

Are you administrator (Windows) or using the user that owns the game directory (Linux) ?

extralismizer · November 28, 2016

I'm using Ubuntu 14.04. and I'm owner of both, client and extractor files. Some (5839) files are being created from the extractors. From where are the maps being extracted? If I'm right informed they are all out of the 4 .MPQ-files of the client.

Is it possible, that my installation creates anyhow "bad" .MPQ-files? The client I have is being installed from 4 CDs (Classic) and 1 DVD (TBC) plus the two patches. At this moment I'm downloading a new client (without installing) to verify if my installation is "bad". Lets see if that helps.

extralismizer · November 29, 2016

Test with new client done. Same result: 5839 files created and server-start aborts at

Please check for the existence of map file '/opt/mangos-server/data/maps/0004331.map'

Any more ideas why this happens?:

Opening Data/common.MPQ
Error opening archive 'Data/common.MPQ': Does file really exist?

I have checked:

- filesystem (ext4)
- user rights (owner of all files with full access)
- PC-power / RAM (using stronger PC)
- client correctnes (using another client-install)

All data extracted are a bit bigger than 600MB. Shouldn't that be much more??

Thanks for the help so far on this and other topics in the past! And sorry to bother you all so much by posting and posting, but I really want to get this server running. Any help would be really appreciated.

Talendrys · November 29, 2016

Hello, I know I had some troubles with mmap & vmap generation on Linux but it went all fine at some point. The process of vmaps generation takes really a long time. Maybe a timeout somewhere ?

antz · November 29, 2016

9 hours ago, extralismizer said:
Test with new client done. Same result: 5839 files created and server-start aborts at
Please check for the existence of map file '/opt/mangos-server/data/maps/0004331.map'
Any more ideas why this happens?:
Opening Data/common.MPQ
Error opening archive 'Data/common.MPQ': Does file really exist?

Does Data/common.MPQ exist in the wow folder ?

extralismizer · November 30, 2016

Yes, all where it is supposed to be:

~/mangos/client/World/Data$ ls -l
insgesamt 7302620
drwxrwxr-x 2 extralismizer extralismizer       4096 Nov 28 18:19 backup
-rw-rw-r-- 1 extralismizer extralismizer 3838254210 Nov 28 17:25 common.MPQ
drwxrwxr-x 5 extralismizer extralismizer       4096 Jun 12 23:14 deDE
-rw-rw-r-- 1 extralismizer extralismizer 1468608919 Nov 28 17:25 expansion.MPQ
-rw-rw-r-- 1 extralismizer extralismizer  125708613 Nov 28 17:24 patch-2.MPQ
-rw-rw-r-- 1 extralismizer extralismizer 2045265633 Nov 28 17:24 patch.MPQ
drwxrwxr-x 2 extralismizer extralismizer       4096 Jun 12 18:05 WTF

I created the backup-folder when using .MPQs of the other client. If I read above my file-sizes seem fine. Also the user-rights should be correct. I don't believe the write-access for "others" is the problem.

extralismizer · December 1, 2016

I couldn't solve the problem, but I found a way to avoid it:

I squeezed out my old Rel17-server and was able to build it on my new machine. As I already had database, maps etc. for this one it was pretty easy and fast. Everything works fine now!

This is not the "golden solution" but first of all I need a running version - which I have now. I can still try to get Rel20 or whatever is up to date when it is not that "urgent" anymore......

Thanks anyway for your replies! I ever feel in good hands in this forum since I had first contact to MaNGOS years ago! Even though it didn't work this time - people are great here!

Keep on, everybody!

scaredy_cat · June 4, 2016

I ought to include this too, this is the head of the MaNGOSExtractor_detailed.log

Sat Jun  4 14:58:28 MDT 2016: Start extracting data for MaNGOS, DBCs/maps 1, vmaps 1, mmaps 1 on 4 processes

       __  __      _  _  ___  ___  ___
      |  \/  |__ _| \| |/ __|/ _ \/ __|
      | |\/| / _` | .` | (_ | (_) \__ \
      |_|  |_\__,_|_|\_|\___|\___/|___/
      DBC Extractor & Map Generator for MaNGOSOne
 ________________________________________________
 ________________________________________________

   For help and support please visit:
   Website / Forum / Wiki: https://getmangos.eu
 ________________________________________________
Detected locale: enUS
Opening ./Data/enUS/locale-enUS.MPQ
Opening ./Data/enUS/patch-enUS.MPQ
Opening ./Data/enUS/patch-enUS-2.MPQ
Detected client build: 8606
___________________________________

Extracting client database files...
Extracted 185 files

Using locale: enUS
Opening ./Data/enUS/locale-enUS.MPQ
Opening ./Data/enUS/patch-enUS.MPQ
Opening ./Data/enUS/patch-enUS-2.MPQ
Opening ./Data/common.MPQ
Opening ./Data/dbc.MPQ
Opening ./Data/expansion.MPQ
Opening ./Data/terrain.MPQ
Opening ./Data/patch.MPQ
Opening ./Data/patch-2.MPQ

Extracting maps...

Reading maps from Map.dbc...  Success! 39 maps loaded.

Read areas from AreaTable.dbc ... Success! 980 areas loaded.

Reading liquid types from LiquidType.dbc... Success! 7 liquid types loaded.

Converting map files
Extract DireMaul (1/39)
Extract EmeraldDream (2/39)

Once again, any input is appreciated.

scaredy_cat · June 4, 2016

For future knowledge to other users who come across this same problem, I found this post, https://www.getmangos.eu/oldinstallation-configuration-amp-upgrades/6667-mangos-maps-extraction.html. It didn't have my exact problem, but it did suggest to reinstall the game in a round about way. I got my official game discs back out, reinstalled WoW and then TBC and then patched it up to 2.4.3 8606.

I copied the client back over to the server and told it to make the dbc, maps, vmaps, and mmaps again and I now have 83 maps in the list instead of the 39 I had previously. Same exact build as before, just with a new install. The total size of my installed client was just under 8GB. I also had my ethernet cord unplugged while I was running the updates. Not sure if that'll be needed, but I would suggest it since the updates launch the launcher after they finish.

I'll let you know when the mmaps are all done if everything is working correctly.

scaredy_cat · June 5, 2016

Turns out that is totally what it was. Everything is cooking nicely now and the bread smells good.

For some reason, the original install of the client didn't have all the MPQ data that map-extractor wanted and it did with it what it could. I had installed vanilla and patched to 1.12.whatever and then installed TBC on that and patched it up to 2.4.3 8606. The install was around 11GB. After this reinstall without patching vanilla and just installing TBC right after vanilla, it turns out to be around 8GB. Everything works now.

Thanks for reading and enjoy your games!

Shaorin · June 5, 2016

thats good. did you get the MMAPS? i get that problem. i get everything else but noi MMAPS get this error:

"Excluded maps: 13 25 29 35 37 42 44 169 451 598

ERROR! Bad arguments!

You can (re)extract mmaps with this helper script,

or recreate only the tiles from the offmash file

Call with number of processes (1 - 4) to create mmaps

Call with 'offmesh' to reextract the tiles from offmash file

For further fine-tuning edit this helper script"

antz · June 8, 2016

[MENTION=2770]Shaorin[/MENTION] can you provide a log file from when you ran the extractresources.sh ?

Shaorin · June 11, 2016

sorry late replay i reinstalled windows went back to 7 from 10.

i its this things you look for:

'

VMAP building complete. No errors.

Start creating MoveMaps

Starting to create MoveMaps

den 5 jun 2016 07:40:12: Finished creating MoveMaps

den 5 jun 2016 07:40:11: Start creating MoveMaps

Used params: --silent --offMeshInput offmesh.txt

Detailed log can be found in MaNGOSExtractor_detailed.log

den 5 jun 2016 07:40:11: (Re)created map 0

den 5 jun 2016 07:40:11: (Re)created map 1

i dont see any other file in wow root folder. that i can think of.

antz · June 13, 2016

could you post MaNGOSExtractor_detailed.log

extralismizer · June 14, 2016

Hey guys,

similar problem for me. After running ExtractResources.sh and copying the files to my core, mangosd says me:

Realm running as realm ID 1

Using World DB: MaNGOSOne Database Rev 20000_33
Using creature EventAI: MaNGOSOne Artificial Creature Intelligence Database

Using DataDir /opt/mangos-server/data/
WORLD: VMap support included. LineOfSight:1, getHeight:1, indoorCheck:1
WORLD: VMap data directory is: /opt/mangos-server/data/vmaps
WORLD: MMap pathfinding enabled

Please check for the existence of map file '/opt/mangos-server/data/maps/0004331.map'
Correct *.map files not found in path '/opt/mangos-server/data/maps' or *.vmtree/*.vmtile files in '/opt/mangos-server/data/vmaps'. Please place *.map and vmap files in appropriate directories or correct the DataDir value in the mangosd.conf file.

Checking the MangosExtractor.log:

Mo 13. Jun 16:38:35 CEST 2016: Start extracting data for MaNGOS
DBC and map files will be extracted
Vmaps will be extracted
Mmaps will be extracted with 1 processes

Mo 13. Jun 16:38:35 CEST 2016: Start extraction of DBCs and map files...
Mo 13. Jun 16:40:19 CEST 2016: Extracting of DBCs and map files finished

Mo 13. Jun 16:40:19 CEST 2016: Start extraction of vmaps...
Mo 13. Jun 16:44:06 CEST 2016: Extracting of vmaps finished
Mo 13. Jun 16:44:06 CEST 2016: Start assembling of vmaps...
Mo 13. Jun 16:44:29 CEST 2016: Assembling of vmaps finished

Mo 13. Jun 16:44:30 CEST 2016: Start creating MoveMaps
Used params: --silent --offMeshInput offmesh.txt
Detailed log can be found in MaNGOSExtractor_detailed.log
Mo 13. Jun 16:51:44 CEST 2016: (Re)created map 0
Mo 13. Jun 16:58:48 CEST 2016: (Re)created map 1
Mo 13. Jun 23:04:59 CEST 2016: (Re)created map 530
Mo 13. Jun 23:21:30 CEST 2016: (Re)created map 534
Mo 13. Jun 23:42:27 CEST 2016: (Re)created map 560
Mo 13. Jun 23:49:24 CEST 2016: (Re)created map 309
Mo 13. Jun 23:54:34 CEST 2016: (Re)created map 533
Di 14. Jun 00:07:33 CEST 2016: (Re)created map 568
Di 14. Jun 00:13:37 CEST 2016: (Re)created map 509
Di 14. Jun 00:19:54 CEST 2016: (Re)created map 30
Di 14. Jun 00:34:05 CEST 2016: (Re)created map 532
Di 14. Jun 00:39:49 CEST 2016: (Re)created map 469
Di 14. Jun 00:46:40 CEST 2016: (Re)created map 33
Di 14. Jun 00:52:13 CEST 2016: (Re)created map 209
Di 14. Jun 00:58:56 CEST 2016: (Re)created map 289
Di 14. Jun 01:04:17 CEST 2016: (Re)created map 329
Di 14. Jun 01:27:32 CEST 2016: (Re)created map 564
Di 14. Jun 01:47:02 CEST 2016: (Re)created map 580
Di 14. Jun 01:59:50 CEST 2016: (Re)created map 543
Di 14. Jun 02:15:35 CEST 2016: (Re)created map 585
Di 14. Jun 02:22:02 CEST 2016: (Re)created map 529
Di 14. Jun 02:31:18 CEST 2016: (Re)created map 572
Di 14. Jun 02:36:50 CEST 2016: (Re)created map 36
Di 14. Jun 02:58:17 CEST 2016: (Re)created map 269
Di 14. Jun 03:04:01 CEST 2016: (Re)created map 489
Di 14. Jun 03:08:31 CEST 2016: (Re)created map 47
Di 14. Jun 03:14:48 CEST 2016: (Re)created map 531
Di 14. Jun 03:19:33 CEST 2016: (Re)created map 562
Di 14. Jun 03:34:23 CEST 2016: (Re)created map 566
Di 14. Jun 03:40:02 CEST 2016: (Re)created map 230
Di 14. Jun 03:46:53 CEST 2016: (Re)created map 429
Di 14. Jun 03:52:49 CEST 2016: (Re)created map 548
Di 14. Jun 04:00:12 CEST 2016: (Re)created map 559
Di 14. Jun 04:05:35 CEST 2016: (Re)created map 34
Di 14. Jun 04:12:08 CEST 2016: (Re)created map 43
Di 14. Jun 04:13:35 CEST 2016: (Re)created map 48
Di 14. Jun 04:20:31 CEST 2016: (Re)created map 70
Di 14. Jun 04:27:20 CEST 2016: (Re)created map 90
Di 14. Jun 04:32:30 CEST 2016: (Re)created map 109
Di 14. Jun 04:38:38 CEST 2016: (Re)created map 129
Di 14. Jun 04:43:05 CEST 2016: (Re)created map 189
Di 14. Jun 04:50:45 CEST 2016: (Re)created map 229
Di 14. Jun 04:55:40 CEST 2016: (Re)created map 249
Di 14. Jun 05:02:16 CEST 2016: (Re)created map 349
Di 14. Jun 05:08:55 CEST 2016: (Re)created map 369
Di 14. Jun 05:09:46 CEST 2016: (Re)created map 389
Di 14. Jun 05:14:22 CEST 2016: (Re)created map 409
Di 14. Jun 05:20:14 CEST 2016: (Re)created map 449
Di 14. Jun 05:26:39 CEST 2016: (Re)created map 450
Di 14. Jun 05:27:42 CEST 2016: (Re)created map 540
Di 14. Jun 05:28:49 CEST 2016: (Re)created map 542
Di 14. Jun 05:29:28 CEST 2016: (Re)created map 544
Di 14. Jun 05:30:57 CEST 2016: (Re)created map 545
Di 14. Jun 05:32:10 CEST 2016: (Re)created map 546
Di 14. Jun 05:33:45 CEST 2016: (Re)created map 547
Di 14. Jun 05:34:49 CEST 2016: (Re)created map 550
Di 14. Jun 05:35:49 CEST 2016: (Re)created map 552
Di 14. Jun 05:37:41 CEST 2016: (Re)created map 553
Di 14. Jun 05:38:09 CEST 2016: (Re)created map 554
Di 14. Jun 05:39:37 CEST 2016: (Re)created map 555
Di 14. Jun 05:40:12 CEST 2016: (Re)created map 556
Di 14. Jun 05:40:49 CEST 2016: (Re)created map 557
Di 14. Jun 05:41:27 CEST 2016: (Re)created map 558
Di 14. Jun 05:41:55 CEST 2016: (Re)created map 565
Di 14. Jun 05:47:08 CEST 2016: (Re)created map 169
Di 14. Jun 05:53:08 CEST 2016: (Re)created map 37
Di 14. Jun 06:00:46 CEST 2016: (Re)created map 451
Di 14. Jun 06:07:30 CEST 2016: (Re)created map 13
Di 14. Jun 06:14:09 CEST 2016: (Re)created map 29
Di 14. Jun 06:19:06 CEST 2016: (Re)created map 35
Di 14. Jun 06:26:14 CEST 2016: (Re)created map 42
Di 14. Jun 06:33:20 CEST 2016: (Re)created map 44
Di 14. Jun 06:34:23 CEST 2016: (Re)created map 598
Di 14. Jun 06:38:50 CEST 2016: (Re)created map 25

Di 14. Jun 06:38:50 CEST 2016: Finished creating MoveMaps

I have just installed Vanilla and TBC and updated it to 2.4.3. Any ideas??

antz · February 6, 2017

@extralismizer- have you tried again recently, we have made some significant changes to the extraction tools since you initially had issues ?

Sign In

[Mangos One] git cloned latest (June-04-2016) and ExtractResources.sh doesn't extract everything

Question

scaredy_cat

21 answers to this question

Recommended Posts

Talendrys

extralismizer

Olion

extralismizer

extralismizer

Talendrys

extralismizer

extralismizer

Talendrys

antz

extralismizer

extralismizer

scaredy_cat

scaredy_cat

scaredy_cat

Shaorin

antz

Shaorin

antz

extralismizer

antz

Archived

Recently Browsing 0 members

Contact Us

Repositories

Support

Wiki

Browse

Activity

My Activity Streams

Important Information