/termfilter

I personally don't think there should be a limit to the number of term filters you should be able to apply to /shout chat. They certainly shouldn't be case-sensitive.

I don't want to see advertisements for in-game venues, nor VENUES, Venues, venue, VENUE, Venue, bingo, BINGO, Bingo, gamba, GAMBA, Gamba, AMBA, amba, AMB, deathroll, DEATHROLL, Deathroll, deathrolls, DEATHROLLS, deathrolls, atmospheric, ATMOSPHERIC, atmospheric, discord, DISCORD, Discord, contest, CONTEST, Contest, contests, CONTESTS, Contests, photobooth, PHOTOBOOTH, photobooth, prize, PRIZE, Prize, prizes, PRIZES, Prizes, giveaway, GIVEAWAY, Giveaway, giveaways, GIVEAWAYS, Giveaways, tourney, TOURNEY, Tourney, tourneys, TOURNEYS, Tourneys, ☆★☆, ☆★, ★★★★ !, raffle, RAFFLE, Raffle, raffles, RAFFLES, Raffles, rp bar, RP BAR, rp Bar, RP bar, tarot, TAROT, Tarot, carrd, CARRD, Carrd, slots, SLOTS, Slots, etc.

Is there a reason there's a limit? I have a chat log with /shout chat disabled. There are times where I'd like to have /shout chat on. My blacklist is full. I'm utilizing the mute list. I'm still seeing advertisements persistently.

It definitely needs improvement, because the first thing spam-shouters did was find ways around it, despite them being the EXACT kind of people it was made to fight against.

incompetence is the reason

somehow Discord and discord are not the same words.

The funniest part that, according to "License" panel, this game is using LUA, probably for UI scripting. And LUA has build-in ":lower()" method for strings, that moves string or word into lower case, for further matching.
Also LUA basic lib has :find() method for strings, with basic "patterns" support, where u can use + - * or ? modifiers for counting repetitions of letters. (like "Dis*rd" will match Discord or Discooooord or Disrd).

Like everything already there, u dont need to program it. And patterns tutorial is like only one page: https://www.lua.org/pil/20.2.html

Yeah agreed although I suspect right now it's an implementation restriction. If I had to guess they're using a naive approach, and hence can't allow too many terms lest they add too much processing time to each chat line.

Quote:

---

Originally Posted by Carighan

Yeah agreed although I suspect right now it's an implementation restriction. If I had to guess they're using a naive approach, and hence can't allow too many terms lest they add too much processing time to each chat line.

---

My guess it that it's way more performant to do one case-insensitive scan for "giveaway" instead of doing N case-sensitive scans for "giveaway", "GIVEAWAY", "Giveaway", "giveaways", "GIVEAWAYS", "Giveaways"...

Fun fact : FFXI added a term filter function some months before FFXIV, it's case-insensitive and has some regex-like syntax. ( https://forum.square-enix.com/ffxi/t...he-Term-Filter )

That's what I mean, I bet they're doing a naive one-by-one "contains" check. Which is terrible, but probably something the intern could cook up in 10 minutes.

Quote:

---

Originally Posted by Gwenkatsu

My guess it that it's way more performant to do one case-insensitive scan for "giveaway" instead of doing N case-sensitive scans for "giveaway", "GIVEAWAY", "Giveaway", "giveaways", "GIVEAWAYS", "Giveaways"...

---

it is not. You just do normalization of original message, like performing lower/upper case transformation. For example normalize "AbCd JJuu" in "abcd jjuu" and then scan for a term word.
its a basic programming thing people learn in schools.

Quote:

---

Originally Posted by Carighan

Yeah agreed although I suspect right now it's an implementation restriction. If I had to guess they're using a naive approach, and hence can't allow too many terms lest they add too much processing time to each chat line.

---

LUA already have all functions needed (u prob only have to adjust string:lower() function for non-english characters, but its not huge deal, utf-8 is ez), they just incompetent

Quote:

---

Originally Posted by Remolia

its a basic programming thing people learn in schools.

---

This is were they also teach reading comprehension, I guess?

If I could just filter "DJ" that would knock out most of the messages I don't want to see.

Quote:

---

Originally Posted by CidHeiral

If I could just filter "DJ" that would knock out most of the messages I don't want to see.

---

Even then they'd just start using unicode or whatever characters to replace the D or the J to avoid the term filter because they're irritatingly insistent that you show up to their venue that 90% of the playerbase don't care about other than the fact that their shout ad is littering the chat.

Quote:

---

Originally Posted by Gwenkatsu

This is were they also teach reading comprehension, I guess?

---

I explained, how its usually done in normal games. I can also write u some lua code as example, since FFXIV UI is powered by LUA:

Code:

---

local termlist = {
 "ababa", "discord", "venue", "msq", "twitch"
} -- termlist example, preprocessed, prenormalized.


local function term_pass(str, termlist)

        str = tostring(str):lower(); -- normalize

        if #str < 3 or type(termlist) ~= "table" then -- ignore short message
                return true;
        end

        print(str);

        for i = 1, #termlist do
                if str:find(termlist[i]) then
                        return false;
                end
        end

        return true;

end

---

the only problem here, that :lower() does not support extended UTF-8 characters, but since it ignores it, its not a big deal, but u can write own :lower() on C/C++ for that.

I made this concept in 7 minutes, I think there are like even better one.

Quote:

---

Originally Posted by CidHeiral

If I could just filter "DJ" that would knock out most of the messages I don't want to see.

---

The problem with that is that you cannot put it in as a regex. So you'd match all instances of "dj", and hence you could no longer adjust to someone being adjacent to you during the wadjet mechanic, etc etc.

If you could at least put in "\s[dj|DJ]\s" or something, that'd work of course.