You can submit missing images to thegamesdb so others can benefit if the gameadb doesn’t have an image.

You can also transfer over your image and then press shift (or select, I can’t remember) once you’ve navigated to the game and edit the image path manually to where you transferred your image over. Just note that you’ll have to select quit from the emulationstation start menu If you want those manual changes saved.

Otherwise you can manually edit the gamelist.xml for that system which accomplished the same thing.

If you used the builtin scraper or my scraper via the retropie-setup script the gamelist is in ~/.emulationstation/gamelists/(system).

If you used my command line scraper it is in the rom folder.

I dont understand how there arent complete gamelists for retropie with all the meta data and images. complete packs… sselph’s tool matches roms to data by Hash… if a tool like his had its own complete db with images and data specifically for ES we would be set. I get that this is the idea behind scrapping these sites but im saying lets remove that dependancy. even have a community driven open contribution wiki or something.

I think it’s better to have a scraper than complete packs as a lot images can take up space, so why add images you don’t need?

or maybe thegamesdb can create a public API… otherwise we can create our own data base of meta data. and that database would only need to scrap data (data mine) off these sites maybe a few times a year.

The “complete pack” is thegamesdb, the scraper is what we have now. You are literally describing the current use case.

http://wiki.thegamesdb.net/index.php/API_Introduction

thegamesdb.net has an api, sselph’s scraper uses the api.

[quote=109118]Sorry where in retropie-setup script do I install this?[/quote]

Sorry I haven’t actually used this from the menu to see but I’ve heard people say the experimental area. Should say something like “Scraper for EmulationStation by Steven Selph”. Herbfargus would know.

[quote=109135]actually its not, switching from a scrapping solution to an api is wayyyyyyyy different and way more efficient, faster and customizable[/quote]

My scraper(for console roms) maps the contents of the rom(via hashing) with the ID in thegamesdb to query the API. It then formats the API response in the format suitable for the XML. This is a fairly efficient method for the systems I have built the mappings for since it only downloads what is needed and doesn’t perform any unneeded search API calls.

There is a project that is attempting to do something like you mention. It relies on the file naming to be done according to the no-intro naming. They used my scraper to seed much of the information.
https://github.com/digitalLumberjack/recalbox-gamelists

[quote=109140]so why is it called a scrapper? its not scrapping.[/quote]
That is what Aloshi called it in ES so I just used the same terminology. It does actually scrape HTML for MAME info.

[quote=109140]I hope they add support for the api to return your choice of game artwork (boxart, screenshot, title etc)[/quote]
The API returns all the images that are available. boxart is almost always there where screenshot, etc are less common. My script, if run from the command line, you can accept the flags -mame_img or -gdb_img depending on which system type you are processing. You can see how to use these with -help

[quote=109144]How hard is it to add a new system…So the matching of hash to id you would’ve had to have done that manually? or did you create a tool[/quote]
To add a new system I have to find a set of hashes for the rom set. Typically from no-intro. I have to determine how the rom data is formatted. Some systems like nes have headers which aren’t included in the hash. Some systems like megadrive and n64 have multiple encodings for the same data so I have to convert them on the fly to the correct format. Once I’ve determined how to hash a file, I started mapping hash to ID with the help of some scripts and spreadsheets. So it has some automation but still very manual.

[quote=109144]for arcade games (in particular mame) could you use the mameinfo dat files to create the xml gamelists?[/quote]
For arcade platforms I am not doing the best job. I use the name since that is a good key for these systems then I scrape mamedb.com/game/(name) plus some info from a history file. I should try and map the name to the correct name for the mame version, but what I have has been good enough for most people.