The test involved finding the targets of Veteran Clan Hunts. Veteran Clan Hunts were introduced in Stormblood, so the data has floated around the internet for several years. The hunts fall into 1-, 2-, and 3-star types based on level. Since my Dragoon job is at level 64, I could grab the first two classes. Each bill lists 5 mobs and new bills are available each day. So 10 sets of mobs to kill. A nice round number. Let's see how Copilot performed.
One-star Veteran Clan Marks
The first mob on my hunt list was the Gazelle Hawk. A very plain, uninteresting mob unless one likes graphics. I asked Copilot for the location and I was told the correct zone, The Fringe, but given the wrong coordinates, (x:16.1, y:13.9). Instead of the coordinates for the Gazelle Hawk, I was given the coordinates for the Soldier Gazellehawk. The actual coordinates were (x:10,y:11).
Next up was the Diakka. I just received the zone and area, which would be helpful if the information wasn't given as part of the description of the target. But the area is very large so I pressed Copilot for the coordinates. I received (x:10, y:12). I think Copilot was giving me the coordinates to Kirnis, the boss of the FATE "The Evil Seed", although the coordinates were off for the FATE also. I should add that the wiki page was titled Diakka (Enemy) so perhaps that threw the AI off.
From here I'm going to depart from the actual order I performed the searches. I performed a search for a two-star mark in The Fringe because I was trying to limit my travel. But for one-star marks, my request was for the location of the Crag Claw. Here was Copilot's first success. I did follow Copilot's link and it led to the page for Tail Screw, a level 1 Blue Mage spell. But I did receive the coordinates (25,11) which are the first set of coordinates on the Crag Claw page.
Next up was the Unkiu. Copilot insisted the crabs were in the Dimwold area in The Fringe. I didn't check out whether the mob was located there since the crabs are located in The Ruby Sea at (32.2,16.8). If a miss was really great, I didn't go and double-check by visiting the location. But I didn't remember seeing any crabs when I visited the area looking for Diakka.
The final one-star mark was Gasame. Copilot told me the correct area (Hells' Lid) and with a prompt gave me the coordinates (31.4,37.1). Close, but not close enough as the actual coordinates are (24.4,33.2). And I can't even blame the AI getting the common mob confused with Hellish Gasame which is found in the instance Hells' Lid.
Two-star Veteran Clan Marks
Okay, so for the first set of marks Copilot gave the correct location 1 out of 5 times. How about the higher level two-star marks? The first mob I asked about, Gazelle, Copilot gave me the first set of coordinates listed on the wiki page, The Fringes Copilot (23.4, 31.1). And in my actual order of queries, I asked about Gazelle right before asking about the Crag Claw. So Copilot was doing better.
The next two mobs lead me to believe Copilot hates Yanixa. The first was Taoquan. The AI told me I would find Taoquan in The Fringe. When I told Copilot Taoquan were not located in The Fringe, the AI apologized and wanted to send me to The Peaks instead. At that point I just followed the wiki's instructions to go to Yanixa (30,34) and moved on.
The next mob I asked about were Minobi. These mobs live in rice paddies in Yanixa (31,20). But Copilot wanted me to search for them on the fiery hot land of Hells' Lid. After the conversation over Taoquan, I just went to the rice paddies without arguing.
Next I asked about Matanga. Copilot would have sent me to Thavnair, which would have been okay except I needed to advance another 20 levels to get to the Endwalker zone. As far as I could tell, Copilot became confused between Endwalker's Arkasodara, who are also Matanga, and the Stormblood NPCs. So I gave Copilot some prompts and I did receive coordinates of (26.1,11.2) in The Azim Steppe. A very nice view, but unfortunately that location was on the other side of the map from the actual location of (9,21).
Finally I concluded with Halgai. Another mob found in The Azim Steppe, I received coordinates not found on the wiki (17.5,15.2) but found my targets anyway. So for the first time Copilot provided me a valid location not found on the wiki. Another success.
Overall results
Honestly I'm not very impressed. Three out of ten is usually a failing grade. Sure, finding the locations of 10 mobs is a small sample size, but do I really want to take the chance Copilot will be more accurate in newer content? As always when AI is involved, verify everything. But when the subject is finding locations in Final Fantasy XIV, I'll stick with a wiki.
No comments:
Post a Comment