[zero] Lots of DB errors on new install

[rage_311]

At least hundreds of these for various guids:

2014-06-04 21:09:29 ERROR:Table creature_movement contain path for creature guid 590000, but this creature guid does not exist. Skipping.
2014-06-04 21:09:29 ERROR:Table creature_movement contain path for creature guid 590000, but this creature guid does not exist. Skipping.

Hundreds of these:

2014-06-04 21:09:29 ERROR:Table creature_movement_template references unknown creature template 412. Skipping.
2014-06-04 21:09:29 ERROR:Table creature_movement_template references unknown creature template 412. Skipping.

This is all of these:

2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 1.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 41202.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 41203.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 143301.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 143302.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 143303.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 143304.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 143305.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 298301.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 406801.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 504301.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 590101.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 590102.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760401.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760402.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760409.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760501.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760502.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760509.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760601.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760602.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760609.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760701.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760702.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760706.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760707.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760713.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760801.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760802.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 760809.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 902201.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 967901.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 1258101.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 1435401.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 1435402.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 1763501.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 1763502.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_creature_movement` contain unused script, id 1799501.

Lots of these:

2014-06-04 21:09:29 ERROR:Table `dbscripts_on_quest_start` has invalid creature (Entry: 9461) in SCRIPT_COMMAND_TEMP_SUMMON_CREATURE for script id 4023
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_quest_start` has invalid creature (Entry: 9546) in SCRIPT_COMMAND_TEMP_SUMMON_CREATURE for script id 4265
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_quest_start` has buddyEntry = 9546 in command 0 for script id 4265, but this creature_template does not exist, skipping.
2014-06-04 21:09:29 ERROR:Table `dbscripts_on_quest_start` has buddyEntry = 9546 in command 1 for script id 4265, but this creature_template does not exist, skipping.

Lots of these:

2014-06-04 21:09:29 ERROR:Table `db_script_string` has unused string id 2000000054
2014-06-04 21:09:29 ERROR:Table `db_script_string` has unused string id 2000000057
2014-06-04 21:09:29 ERROR:Table `db_script_string` has unused string id 2000000058

These:

2014-06-04 21:09:24 Loading Waypoint scripts...
2014-06-04 21:09:24 dbscripts_on_creature_movement :
2014-06-04 21:09:24 ERROR:Table `dbscripts_on_creature_movement` has buddyEntry = 1427 in command 0 for script id 143303, but this creature_template does not exist, skipping.
2014-06-04 21:09:24 ERROR:Table `dbscripts_on_creature_movement` has buddyEntry = 1427 in command 0 for script id 143303, but this creature_template does not exist, skipping.
2014-06-04 21:09:24 ERROR:Table `dbscripts_on_creature_movement` has buddyEntry = 483 in command 0 for script id 143304, but this creature_template does not exist, skipping.
2014-06-04 21:09:24 ERROR:Table `dbscripts_on_creature_movement` has buddyEntry = 1533 in command 20 for script id 153301, but this creature_template does not exist, skipping.
2014-06-04 21:09:24 ERROR:Table `dbscripts_on_creature_movement` has buddyEntry = 1533 in command 20 for script id 153301, but this creature_template does not exist, skipping.
2014-06-04 21:09:24 ERROR:Table `dbscripts_on_creature_movement` has buddyEntry = 3419 in command 0 for script id 406801, but this creature_template does not exist, skipping.
2014-06-04 21:09:24 ERROR:Table `dbscripts_on_creature_movement` has invalid creature (Entry: 11256) in SCRIPT_COMMAND_TEMP_SUMMON_CREATURE for script id 590101
2014-06-04 21:09:24 ERROR:Table `dbscripts_on_creature_movement` has buddyEntry = 11256 in command 0 for script id 590101, but this creature_template does not exist, skipping.
2014-06-04 21:09:24 ERROR:Table `dbscripts_on_creature_movement` has buddyEntry = 11256 in command 0 for script id 590101, but this creature_template does not exist, skipping.
2014-06-04 21:09:24 ERROR:Table `dbscripts_on_creature_movement` has buddyEntry = 11256 in command 0 for script id 590101, but this creature_template does not exist, skipping.
2014-06-04 21:09:24 ERROR:Table `dbscripts_on_creature_movement` has buddyEntry = 7267 in command 0 for script id 760713, but this creature_template does not exist, skipping.
2014-06-04 21:09:24
2014-06-04 21:09:24 >> Loaded 52 script definitions

2014-06-04 21:09:21 >> Loaded `npc_trainer_template`, table is empty!
2014-06-04 21:09:21 ERROR:Table `npc_trainer` have entry for nonexistent creature template (Entry: 198), ignore
2014-06-04 21:09:21 ERROR:Table `npc_trainer` have entry for nonexistent creature template (Entry: 198), ignore
2014-06-04 21:09:21 ERROR:Table `npc_trainer` have entry for nonexistent creature template (Entry: 198), ignore
2014-06-04 21:09:21 ERROR:Table `npc_trainer` have entry for nonexistent creature template (Entry: 198), ignore

And a lot more. This is on Rel19 on FreeBSD. What am I missing here?

I haven't seen a cohesive and up-to-date guide on the DB setup, so I might have just done something wrong. Basically:

From mangoszero/server repo:

mysql -uroot < create_mysql.sql
mysql -uroot mangos < mangos.sql
mysql -uroot realmd < realmd.sql
mysql -uroot characters < characters.sql
cd ../src/bindings/scripts/sql
mysql -uroot < scriptdev2_create_database.sql
mysql -uroot scriptdev2 < scriptdev2_create_structure_mysql.sql
mysql -uroot scriptdev2 < scriptdev2_script_full.sql
mysql -uroot mangos < mangos_scriptname_full.sql

From mangoszero/database repo:

cd _tools
./make_full_db.sh
mysql -uroot mangos < full_db.sql

Then when I run mangosd, it says I need all the updates between 2441 and 2514 (I think those are the numbers). So I apply all of those from the server repo's sql/updates folder from low to high. Then I run it and get all of these nice errors. I'm sure I'm doing something wrong, but I don't know how to do it right... help?

[Hikari]

It looks almost like you've empty creature_template and creature tables.

Little sidenote, which has nothing to do with your current problem:

You've to apply mangos_scriptname_full.sql after you imported full_db.sql, because it affects the data and not the table structures. In your current workflow you apply it to the empty tables, which won't have any effects.

[rage_311]

It looks almost like you've empty creature_template and creature tables.

Little sidenote, which has nothing to do with your current problem:

You've to apply mangos_scriptname_full.sql after you imported full_db.sql, because it affects the data and not the table structures. In your current workflow you apply it to the empty tables, which won't have any effects.

mysql> select count(*) from creature_template;
+----------+
| count(*) |
+----------+
|     9091 |
+----------+
1 row in set (0.00 sec)

I checked several other tables that reported issues too, and they all have at least SOME data... except for the npc_trainer_template which has 0 records. I'm not sure what's happening here. Are any of the sql scripts in the database repo's "_updates" folder relevant?

Thanks for the note on the mangos_scriptname_full.sql. It's difficult to tell what's doing what without inspecting every script.

[antz]

i have now created a tracker task based on this https://www.getmangos.eu/issue.php?issueid=134

[rage_311]

Thanks.

It's frustrating to get this far with the FreeBSD build only to run into some supposed DB issues. I'll dive deeper into this soon.

[rage_311]

Well, it's not just FreeBSD. Rel19 doesn't work on any *nixes I've tried it on: Ubuntu 12.04.4, FreeBSD 10, Arch, Mint 14... Sure, it compiles, but all but my FreeBSD build segfault when exiting.

The database/scriptdev seems to be messed up as well. mangosd spits out lots of errors about creature_template_classlevelstats (because it's empty), this is just a few of them:

Creature (Entry: 17699), level(1) has no data in `creature_template_classlevelstats`
Creature (Entry: 17719) has invalid `UnitClass(0)` in creature_template
Creature (Entry: 17719), level(1) has no data in `creature_template_classlevelstats`
Creature (Entry: 17720) has invalid `UnitClass(0)` in creature_template
Creature (Entry: 17720), level(1) has no data in `creature_template_classlevelstats`
Creature (Entry: 17765), level(60) has no data in `creature_template_classlevelstats`
Creature (Entry: 17766), level(60) has no data in `creature_template_classlevelstats`
Creature (Entry: 17794) has invalid `UnitClass(0)` in creature_template
Creature (Entry: 17794), level(1) has no data in `creature_template_classlevelstats`
Creature (Entry: 17795), level(1) has no data in `creature_template_classlevelstats`
Creature (Entry: 17804), level(52) has no data in `creature_template_classlevelstats`
Creature (Entry: 17995) has invalid `UnitClass(0)` in creature_template
Creature (Entry: 17995), level(60) has no data in `creature_template_classlevelstats`
Creature (Entry: 17996) has invalid `UnitClass(0)` in creature_template
Creature (Entry: 17996), level(60) has no data in `creature_template_classlevelstats`

And lots of errors about Event xxxxx Action1:

Event 22301 Action1 uses incorrect Target type 1 for event-type 10 (can not be used OOC)
Event 27701 Action1 uses incorrect Target type 1 for event-type 10 (can not be used OOC)
Event 27901 Action1 uses incorrect Target type 1 for event-type 10 (can not be used OOC)
Event 29701 Action1 uses incorrect Target type 1 for event-type 10 (can not be used OOC)
Event 33101 Action1 uses incorrect Target type 1 for event-type 10 (can not be used OOC)
Event 33201 Action1 uses incorrect Target type 1 for event-type 10 (can not be used OOC)
Event 33801 Action1 uses incorrect Target type 1 for event-type 10 (can not be used OOC)
Event 34001 Action1 uses incorrect Target type 1 for event-type 10 (can not be used OOC)
Event 37601 Action1 uses incorrect Target type 1 for event-type 10 (can not be used OOC)
Event 43101 Action1 uses incorrect Target type 6 for event-type 12

And finally,

Initializing Scripts...
Scripting library not found or not accessible.

Has anyone run Rel19 on *nix any time recently? Can anyone give me a concise rundown about the needed steps to set up the database? It seems really scattered: apply the .sql files from the sql folder in the server repo, find the scriptdev2 sql files and apply those (from src/bindings/scripts/sql", then apply the full_db.sql from the database repo, then go back to the server repo and apply src/bindings/scripts/sql/mangos_scriptname_full.sql, then the updates that you need from the sql/updates folder. Is that even the right order? Do I really need to do all of them?

What is the "scripting library" and where is it supposed to be? Did I miss a step somewhere?

If that all sounds right, maybe give me the distro, gcc/libgcc, ACE, TBB, libssl, mysql, etc. versions that you've had success with. I've been banging my head on this one for way too long now. Any help would be greatly appreciated. Thanks.

EDIT: Also, if it would be helpful, I can upload my world-* logs so you can see the whole thing.

[Unkle Nuke]

The database install and application of updates must be done in exact order or it will cause all kinds of troubles, including what you have reported here. I"m not saying that is the only reason why you're having these issues, but it would help to narrow things down if you can wipe your database, then re-install it and write down each and every step as you go along. Post that record to help us spot any mistakes, such as an update applied out or the correct order.

Antz has been working on a few utilities, including an automatic database installer. Meanwhile, there are several utilities and bash scripts you may wish to look at that are designed for installing and managing your database. You'll find them either in our MangosTools repository at Github or in our forum, under Community Projects.

You can upload your logs to Paste2, then link to it in a post. It's how we handle large amounts of text, such as program code and logs, while avoiding clutter in the forums. There's also the original Pastebin, but it's now a commercial site that requires you to register an account before using their service.

(Hey, Max! when do we get <Spoiler> buttons for hiding walls-o-text, instead of having to link to outside sites?).

We are currently very short-handed in the Linux and BSD departments. Most of our Dev Team consists of Windows guys. It's going to take time to fill out the team, but Wolverine is our in-house BSD expert while I believe Xenithar can provide insights on Linux.

Rel19 for Zero is still a bit of a mess. On behalf of Antz and those who might be helping him, I ask for your patience. Antz started Rel19 only three months ago, to fix a lot of fundamental issues with Zero. The goal is to have Zero in a complete and ordered state as near as possible so future developers can jump right in and start creating more improvements.

It's a complete overhaul of everything, but it is also a massive amount of work. Just the server alone would take one ordinary man a year to fully refactor and debug. But, we are talking about Antz here. He's sometimes suspected of being a coder-bot, given the inhuman amount of work he produces every week.

I wish Antz had more people helping him full-time. If you would like to help out with fixing issues in Re19, we'd love to have you! :cool:

[madmax]

Just attach the text/log file to the post and insert it "inline" into the post and users can download the entire log file.

[antz]

A new Rel20 branch is available which has a lot of fixes in it, would you mind pulling and building it to see how much it's improved things ?

git clone http://github.com/[url="http://github.com/mangoszero/server"]mangoszero/server[/url] --recursive -b Rel20