How to Call character info for web developers?

Printable View

10-31-2011, 09:33 PM
alexi14

How to Call character info for web developers?

Hi,

I'm working on a website for my LS, and I'd like to be able to call character info. I don't see any XML pages to call from, or really anything. I know a lot of sites are doing it such as ffxivpro, but I don't see any documentation anywhere.

Can anyone help please?

Thanks,

Astin
11-01-2011, 07:43 PM
alexi14

bump,,,,,,,,,,,
11-01-2011, 07:48 PM
Aleczan

Hope a dev or some other fan site developer would answer this. My enjin's signature is broken, would be great to get one of my own hosted on my server.
11-01-2011, 08:31 PM
Coldfire

It's most likely done by analyzing the HTML-code for each characters lodestone site. You basically search the code for certain words or tags and then read the information from there. Is pretty simple but if SE changes the layout you have to update your method. Usually this is done at certain time intervals and not every time the site is loaded (so you don't get into trouble with SE :P )
11-02-2011, 11:33 AM
alexi14

So scraping?
11-02-2011, 05:56 PM
Coldfire

Web scraping, yes. For example you search for "Shield" and the next number between bold-tags is the shield level.
11-02-2011, 05:59 PM
Lebannen

would be cool if we get a service like the one you mentioned.
11-03-2011, 12:02 AM
Coldfire

Had some free time and put together some code to fetch the data http://pastebin.com/6y7VtjDu
It's written in ASP.NET and not very pretty :P
As usual with stuff like this I'm not responsible if it blows up your server, but you are free to use, alter and distribute it.
11-04-2011, 01:21 PM
alexi14

I know like 0 c# though. Is it possible to give me an example in PHP? I can get the scraping part myself, but I don't understand how to go from a Character Name and server to a ID number that the website uses.
11-04-2011, 05:31 PM
Coldfire

You will have to use the lodestone character search for that. The ID is in the link to the character's subpages. I think sites like ffxivpro just scan through all the numbers to get all character data. But if you only need it for a small group of people or even just for yourself you can use the lodestone search and copy the IDs from there. Beware though that if you are logged in there will be no ID for your own page shown in the address.
11-05-2011, 11:05 AM
BreeWhisperwind

This is very interesting. I'm going have to try out creating a web scraper.
11-09-2011, 08:00 PM
alexi14

Okay, so I've wrote a script that will take the info from the URL, and give you basic information about the character. The data is saved in variables so that you can input them into a database if you like.

All you need to do is change the URL of the profile of the character you wish to see.

Quote:

<?php

//-- This code is written by Astin Prey. Leader of Kisses and Kissed LS on Gysahl Server.
//-- If you have any questions, you can simple send me a tell, or ask in a post on the forums @ www.kissesls.net

$url = "http://lodestone.finalfantasyxiv.com/rc/character/status?cicuid=9060322";
$curl = curl_init();
curl_setopt($curl, CURLOPT_URL, $url);
curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);
curl_setopt($curl, CURLOPT_HEADER, false);
curl_setopt($curl, CURLOPT_USERAGENT, 'http://www.useragentstring.com/Firefox6.0_id_18845.php');
curl_setopt($curl, CURLOPT_HTTPHEADER, array('Accept-Language: en-us,en;q=0.5'));
$html = curl_exec($curl);
curl_close($curl);

$value = preg_match('/Sword<\/td><td[^>]+>(\d+)<\/b>/', $html, $matches);
$sword = $matches[1];

$value = preg_match('/Axe<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$axe = $matches[1];

$value = preg_match('/Archery<\/td><td[^>]+>(\d+)<\/b>/', $html, $matches);
$archery = $matches[1];

$value = preg_match('/Hand\-to\-Hand<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$hand = $matches[1];

$value = preg_match('/Polearm<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$polearm = $matches[1];

$value = preg_match('/Shield<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$shield = $matches[1];

$value = preg_match('/Conjury<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$conjury = $matches[1];

$value = preg_match('/Thaumaturgy<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$thaumaturgy = $matches[1];

$value = preg_match('/Woodworking<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$woodworking = $matches[1];

$value = preg_match('/Armorcraft<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Armorcraft = $matches[1];

$value = preg_match('/Leatherworking<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Leatherworking = $matches[1];

$value = preg_match('/Alchemy<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Alchemy = $matches[1];

$value = preg_match('/Smithing<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Smithing = $matches[1];

$value = preg_match('/Goldsmithing<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Goldsmithing = $matches[1];

$value = preg_match('/Clothcraft<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Clothcraft = $matches[1];

$value = preg_match('/Cooking<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Cooking = $matches[1];

$value = preg_match('/Mining<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Mining = $matches[1];

$value = preg_match('/Fishing<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Fishing = $matches[1];

$value = preg_match('/Botany<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Botany = $matches[1];

echo "Sword: " . $sword;
echo " ";
echo "Axe: " . $axe;
echo " ";
echo "Archery: " . $archery;
echo " ";
echo "Hand-to-Hand: " . $hand;
echo " ";
echo "Polearm: " . $polearm;
echo " ";
echo "Shield: " . $shield;
echo " ";
echo "Conjury: " . $conjury;
echo " ";
echo "Thaumaturgy: " . $thaumaturgy;
echo " ";
echo "Woodworking: " . $woodworking;
echo " ";
echo "Armorcraft: " . $Armorcraft;
echo " ";
echo "Leatherworking: " . $Leatherworking;
echo " ";
echo "Alchemy: " . $Alchemy;
echo " ";
echo "Smithing: " . $Smithing;
echo " ";
echo "Goldsmithing: " . $Goldsmithing;
echo " ";
echo "Clothcraft: " . $Clothcraft;
echo " ";
echo "Cooking: " . $Cooking;
echo " ";
echo "Mining: " . $Mining;
echo " ";
echo "Fishing: " . $Fishing;
echo " ";
echo "Botany: " . $Botany;

?>

Please don't be mean to me about the code. I'm 15, and not super good yet. I made this in a hurry, and I just thought I'd post it for users who need something similar :)
11-09-2011, 08:51 PM
Aleczan

Wow. Excellent. Let me try it!

I can use codes and I can upload stuff/config my own blog/website, but there's no way I would be able to make the codes to work for a specific task like this, so nope I won't be mean at you. Thank you for sharing!
11-09-2011, 09:05 PM
alexi14

Hey, I've actually added to the code. Baisicly I didn't want users to need to tell me their profile URL to get the info on them. Instead I added some more code to do all that automaticly. All this needs is their first and last name. I've added a form where you can enter any player on the server and get their info, and then it shows it. this only works for my server though. You will need to change it if you want it to work for another server. just change the server name in the code

Quote:

<?php
if($_POST['first'] == NULL)
{
?>

<html>
<form method="post" action="scrape2.php">
<input type="text" value="First Name" name="first" /> <input value="Last Name" type="text" name="last" /><input type="submit" value="Get Info" />
</form>
</html>

<?php
}
else
{
$first = $_POST['first'];
$last = $_POST['last'];

$url = "http://lodestone.finalfantasyxiv.com/rc/search/search?q=" . $first . "+" . $last;
$curl = curl_init();
curl_setopt($curl, CURLOPT_URL, $url);
curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);
curl_setopt($curl, CURLOPT_HEADER, false);
curl_setopt($curl, CURLOPT_USERAGENT, 'http://www.useragentstring.com/Firefox6.0_id_18845.php');
curl_setopt($curl, CURLOPT_HTTPHEADER, array('Accept-Language: en-us,en;q=0.5'));
$html = curl_exec($curl);
curl_close($curl);

$value = preg_match('/href="\/rc\/character\/top\?cicuid=(\d+)">[^<]+<\/a><\/td><\/tr><\/table><\/td><td class="contents\-table1TD2" align="center">[^<]+<\/td><td class="contents\-table1TD1" align="center">Gysahl/', $html, $matches);
$val = $matches[1];

//-- This code is written by Astin Prey. Leader of Kisses and Kissed LS on Gysahl Server.
//-- If you have any questions, you can simple send me a tell, or ask in a post on the forums @ www.kissesls.net

$url = "http://lodestone.finalfantasyxiv.com/rc/character/status?cicuid=" . $val;
$curl = curl_init();
curl_setopt($curl, CURLOPT_URL, $url);
curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);
curl_setopt($curl, CURLOPT_HEADER, false);
curl_setopt($curl, CURLOPT_USERAGENT, 'http://www.useragentstring.com/Firefox6.0_id_18845.php');
curl_setopt($curl, CURLOPT_HTTPHEADER, array('Accept-Language: en-us,en;q=0.5'));
$html = curl_exec($curl);
curl_close($curl);

$value = preg_match('/Sword<\/td><td[^>]+>(\d+)<\/b>/', $html, $matches);
$sword = $matches[1];

$value = preg_match('/Axe<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$axe = $matches[1];

$value = preg_match('/Archery<\/td><td[^>]+>(\d+)<\/b>/', $html, $matches);
$archery = $matches[1];

$value = preg_match('/Hand\-to\-Hand<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$hand = $matches[1];

$value = preg_match('/Polearm<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$polearm = $matches[1];

$value = preg_match('/Shield<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$shield = $matches[1];

$value = preg_match('/Conjury<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$conjury = $matches[1];

$value = preg_match('/Thaumaturgy<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$thaumaturgy = $matches[1];

$value = preg_match('/Woodworking<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$woodworking = $matches[1];

$value = preg_match('/Armorcraft<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Armorcraft = $matches[1];

$value = preg_match('/Leatherworking<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Leatherworking = $matches[1];

$value = preg_match('/Alchemy<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Alchemy = $matches[1];

$value = preg_match('/Smithing<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Smithing = $matches[1];

$value = preg_match('/Goldsmithing<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Goldsmithing = $matches[1];

$value = preg_match('/Clothcraft<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Clothcraft = $matches[1];

$value = preg_match('/Cooking<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Cooking = $matches[1];

$value = preg_match('/Mining<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Mining = $matches[1];

$value = preg_match('/Fishing<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Fishing = $matches[1];

$value = preg_match('/Botany<\/t[dh]><td[^>]+>(\d+)<\/b>/', $html, $matches);
$Botany = $matches[1];

echo "Sword: " . $sword;
echo " ";
echo "Axe: " . $axe;
echo " ";
echo "Archery: " . $archery;
echo " ";
echo "Hand-to-Hand: " . $hand;
echo " ";
echo "Polearm: " . $polearm;
echo " ";
echo "Shield: " . $shield;
echo " ";
echo "Conjury: " . $conjury;
echo " ";
echo "Thaumaturgy: " . $thaumaturgy;
echo " ";
echo "Woodworking: " . $woodworking;
echo " ";
echo "Armorcraft: " . $Armorcraft;
echo " ";
echo "Leatherworking: " . $Leatherworking;
echo " ";
echo "Alchemy: " . $Alchemy;
echo " ";
echo "Smithing: " . $Smithing;
echo " ";
echo "Goldsmithing: " . $Goldsmithing;
echo " ";
echo "Clothcraft: " . $Clothcraft;
echo " ";
echo "Cooking: " . $Cooking;
echo " ";
echo "Mining: " . $Mining;
echo " ";
echo "Fishing: " . $Fishing;
echo " ";
echo "Botany: " . $Botany;
}
?>