Filter_Stopwords ( Text )

simple one function stopwords remover

Average rating: 4.6 (32 votes) Log in to vote

ThomasSeidler - Show more from this author
The Good Book Company Ltd
http://www.thegoodbook.co.uk

Sample input:

Let(
text = "The Good and Book of Company";

Filter_Stopwords ( text )
& "¶" &
Filter_Stopwords ( lower(text) )

)

Sample output:

"The Good Book Company
good book company"

// i.e. capitalized stopwords stay in, unless you use 'lower' on text

Function definition: (Copy & paste into FileMaker's Edit Custom Function window)

/* get rid of stopwords from supplied text... - removes only lower case stops
thanks to http://www.dcs.gla.ac.uk/idom/ir_resources/linguistic_utils/stop_words for the list...
*/

Let(
[
text = " " & text & " ";
stopwords = "a¶about¶above¶across¶after¶afterwards¶again¶against¶all¶almost¶alone¶along¶already¶also¶although¶always¶am¶among¶amongst¶amoungst¶amount¶an¶and¶another¶any¶anyhow¶anyone¶anything¶anyway¶anywhere¶are¶around¶as¶at¶back¶be¶became¶because¶become¶becomes¶becoming¶been¶before¶beforehand¶behind¶being¶below¶beside¶besides¶between¶beyond¶bill¶both¶bottom¶but¶by¶call¶can¶cannot¶cant¶co¶computer¶con¶could¶couldnt¶cry¶de¶describe¶detail¶do¶done¶down¶due¶during¶each¶eg¶eight¶either¶eleven¶else¶elsewhere¶empty¶enough¶etc¶even¶ever¶every¶everyone¶everything¶everywhere¶except¶few¶fifteen¶fify¶fill¶find¶fire¶first¶five¶for¶former¶formerly¶forty¶found¶four¶from¶front¶full¶further¶get¶give¶go¶had¶has¶hasnt¶have¶he¶hence¶her¶here¶hereafter¶hereby¶herein¶hereupon¶hers¶herself¶him¶himself¶his¶how¶however¶hundred¶i¶ie¶if¶in¶inc¶indeed¶interest¶into¶is¶it¶its¶itself¶keep¶last¶latter¶latterly¶least¶less¶ltd¶made¶many¶may¶me¶meanwhile¶might¶mill¶mine¶more¶moreover¶most¶mostly¶move¶much¶must¶my¶myself¶name¶namely¶neither¶never¶nevertheless¶next¶nine¶no¶nobody¶none¶noone¶nor¶not¶nothing¶now¶nowhere¶of¶off¶often¶on¶once¶one¶only¶onto¶or¶other¶others¶otherwise¶our¶ours¶ourselves¶out¶over¶own¶part¶per¶perhaps¶please¶put¶rather¶re¶same¶see¶seem¶seemed¶seeming¶seems¶serious¶several¶she¶should¶show¶side¶since¶sincere¶six¶sixty¶so¶some¶somehow¶someone¶something¶sometime¶sometimes¶somewhere¶still¶such¶system¶take¶ten¶than¶that¶the¶their¶them¶themselves¶then¶thence¶there¶thereafter¶thereby¶therefore¶therein¶thereupon¶these¶they¶thick¶thin¶third¶this¶those¶though¶three¶through¶throughout¶thru¶thus¶to¶together¶too¶top¶toward¶towards¶twelve¶twenty¶two¶un¶under¶until¶up¶upon¶us¶very¶via¶was¶we¶well¶were¶what¶whatever¶when¶whence¶whenever¶where¶whereafter¶whereas¶whereby¶wherein¶whereupon¶wherever¶whether¶which¶while¶whither¶who¶whoever¶whole¶whom¶whose¶why¶will¶with¶within¶without¶would¶yet¶you¶your¶yours¶yourself¶yourselves";
stopwords_sub_list = "[\" " & Substitute(stopwords; "¶"; " \"; \" \"]; [\" ") & " \"; \" \"]";
formula = "substitute(\"" & text & "\"; " & stopwords_sub_list & ")"
];

Trim(Evaluate(formula)
)

)

Removes stopwords [a very long list provided via a uni] from text. Defaults to only removing lower case stopwords, so fairly simple.

Comments

		chris, detroit Oct 26, 2016
is anyone else getting an error at "text = " " & text & " ";" using fmp 13 thanks

Note: these functions are not guaranteed or supported by BrianDunning.com. Please contact the individual developer with any questions or problems.

Filter_Stopwords ( Text )

Comments

Support this website.

Support this website.