Spammers, ugh… sorry, internet marketers use various means to promote products and services over the Internet. Sending unsolicited emails, posting junky comments on blogs and forums and, in general, making life of other people difficult.
Last week we looked closer at SEO (Search Engine Optimization) and how Wikidot was being (ab)used by marketers to promote online content.
Meet SEO
A short explanation what SEO is: most people search the internet using Google or other search engines1. E.g. if you are looking for a store with cat food, you most likely type "where to buy cat food", "cat food best price" or "cat food in London" into Google. On the other hand, if you are a shop owner, you would like to be listed on the very top of the search results. SEO is a set of techniques that tell you how to make your website "Google-friendly".
Meet black-hat SEO
Google and other search engines rank results by relevancy and how well recognized a given website is. Just having an online store is not enough. To show importance of your website, you need other websites to link to yours. The more links, the more Google thinks your website is important. Sounds reasonable? Right. Until some start cheating.
Meet automated content creation
So how do you get such links? You can encourage bloggers to write about your website. You could ask friends to link to you from their websites. But you can also buy them legitimately. There are online brokers that will sell you links on decent and high-ranked websites.
But there is a cheaper way: use free services (like Wikidot, Wordpress and hundreds of others) to create sites, pages, blog posts and comments that link to each other, and to the website you are promoting. This way a person can create a whole universe of websites, all for free, that will try to cheat Google into thinking your store with cat food is really well known and popular. Otherwise, why would so many websites link to it?
Creating hundreds of pages by hand is possible, but not effective. I would get bored after just a few. Fortunately for some, there are tools to automate the process — setting up fake accounts, starting blogs, wikis etc. They even integrate with paid services that can read captchas. There is a whole universe of tools and the black-hat SEO business, although ethically disputable, is doing pretty well.
Spam content on Wikidot
Over the last few months we have observed increased SEO-related activity, mostly from automated tools. Nothing surprising — Wikidot is a well-known place for publishing content, and new websites are picked up by Google pretty fast. We have seen automated account creation (commonly using Hotmail email addresses), almost bare-bone websites containing just a single article promoting a particular website, linking and being linked from other such sites created on Blogspot, Wordpress, Tumblr etc.
And why don't we like it?
As long as these "marketing sites" are isolated, not affecting other Wikidot sites and users, why would we care? Because they are spam, they cost us real money and they are abusing our platform which is not a place for automated marketing. At Wikidot, we do not want to participate in it.
And one thing for sure — if we don't stop it, Wikidot could be flooded by SEO activity and low-quality websites. I have seen several projects that allowed such activity (because it brings new "users", new "content", and you know, numbers matter) and they are now either dead or losing their business, because legitimate users avoid them.
Site verification from now on
A while ago, with support from our most engaged users, we have started verifying most of the created sites. Most "marketing" sites are usually deleted within a few hours. Of course, there is no impact on legitimate sites.
Also I'd like to give a big thanks to helmuti-pdorf does not match any existing user name, RobElliott, leiger, Timothy Foster, Ed Johnson and Gabrys for helping us to survive the spam flood! It would be much more difficult and much less funny without you.
Disclaimer: In no way do I claim to be an expert in SEO, so please forgive me if I messed up somewhere above.
Image by jisakiel.
Occasionally legitimate sites do get caught out either by Wikidot's automatic spam filters, or by the "spam fighting" team. Anyone that has this happen to them can request that we review it on http://community.wikidot.com - it usually takes less than an hour before the site is restored again.
Out of the thousands of sites that have been killed so far, I think about 3-4 were legitimate sites that were accidentally deleted & then subsequently restored later when the owner asked about it.
Off topic: Does anyone at Wikidot have a Google+ account?
~ Leiger - Wikidot Community Admin - Volunteer
Wikidot: Official Documentation | Wikidot Discord server | NEW: Wikiroo, backup tool (in development)
I do. But I don't understand a thing… (as usual… :P)
If slaughterhouses had glass walls, everyone would be vegan. - Paul McCartney
I have a google+ Account. What do you need? Integrating wikidot and G+?
Does this have anything to do with my I.P. address being blacklisted? I'm unbelievably eager to register up to the 'Demon's Souls' forums, however every time I do I receive this message
Your IP .*..*** has been blocked because it is blacklisted. For details please see http://www.sorbs.net/lookup.shtml?86.8.99.248.
I have absolutely no idea what this means, the only other forum I belong to is a PS3 trophy website where I must have posted as little as three or four times, I followed instructions on the SORBS website which did not help. I'm not sure if I'm posting in the correct place but if ANYBODY could offer any help I would appreciate it immensely.
Thanks for any/all responses.
<a href="http://eu.playstation.com/psn/profile/TheCrabShack/"><img src="http://mypsn.eu.playstation.com/psn/profile/TheCrabShack.png" border="0" /></a>
If you are accessing the Internet from a business or educational institution, it's possible that someone else caused the IP address to be blacklisted.
Quite often, all of the computers in a corporate location like that appear to be from the same IP address to an outside observer.
~ Leiger - Wikidot Community Admin - Volunteer
Wikidot: Official Documentation | Wikidot Discord server | NEW: Wikiroo, backup tool (in development)
Any chance of getting a more explicit direction on how to request a review to get a deleted wiki restored? I may be dense and blind, but nothing jumps out at me in the community as to where to post such a request.
Lynn (D) - Asking about http://aprsisce.wikidot.com/
As you know we have sorted this problem out via PM :)
But for others that have a similar problem, the best place to post is on the community forum:
http://community.wikidot.com/forum:start
Feel free to PM me directly as well if you want… but the forum will be seen by more people and if it's in the middle of the night for my timezone (Australia), the forum will give you a quicker response.
~ Leiger - Wikidot Community Admin - Volunteer
Wikidot: Official Documentation | Wikidot Discord server | NEW: Wikiroo, backup tool (in development)
Just to be clear, the Wikidot gurus are like Thunderbirds; no matter where you post the request in the Community forum, they will see it. But the "General Support Requests" or "Bugs and Problems" categories would probably be the best.
Or email us directly at moc.todikiw|troppus#moc.todikiw|troppus.
We are also receiving emails asking to undelete spam sites, which we try to handle… politely.
Michał Frąckowiak @ Wikidot Inc.
Visit my blog at michalf.me
Ah, so the number may be a little higher than 3 or 4 then.
~ Leiger - Wikidot Community Admin - Volunteer
Wikidot: Official Documentation | Wikidot Discord server | NEW: Wikiroo, backup tool (in development)
Now we need a "fighting tool against abusive users".. :))
I think about a wish where we can ask for an automatic action with all posts/comments of an "abusive user":
Or do we have such wish?
Service is my success. My webtips:www.blender.org (Open source), Wikidot-Handbook.
Sie können fragen und mitwirken in der deutschsprachigen » User-Gemeinschaft für WikidotNutzer oder
im deutschen » Wikidot Handbuch ?
Some days ago, I received an email from a new user, proposing me a date. I marked her/him as abusive user. I don't know what happened with this account …
I also sent to Rob a PM pointong out to this site, because it looked to me as a spam site, because there is only a start page and links to other sitem and it seems to me as something that could be a spam site… I haven't received any feedback yet…
If slaughterhouses had glass walls, everyone would be vegan. - Paul McCartney
Sorry, I've not been able to do anything except work this week,.
Rob Elliott - Strathpeffer, Scotland - Wikidot first line support & community admin team.
I have no chance to delete this site.. could be the user (account deleted) ( a guru from 2008) is apro account?
This would explain why his sites ( a lot of same product) are living?
And about the user: I cannot find any postings… ( the user is already deleted..)
.
Service is my success. My webtips:www.blender.org (Open source), Wikidot-Handbook.
Sie können fragen und mitwirken in der deutschsprachigen » User-Gemeinschaft für WikidotNutzer oder
im deutschen » Wikidot Handbuch ?
Thanks, someone deleted this site..
Service is my success. My webtips:www.blender.org (Open source), Wikidot-Handbook.
Sie können fragen und mitwirken in der deutschsprachigen » User-Gemeinschaft für WikidotNutzer oder
im deutschen » Wikidot Handbuch ?
Me too. It was a classic 419 scam hook line.
It would be useful to have a comment box available when reporting users, because whoever is handling these reports currently needs to do detective work that a more informative report would make unnecessary.
I am very pleased something is being done, though it definitely seems like a lot of work. o__o Kudos to you guys :)
Omnia mutantur, nihil interit.
Okay, so what is the long term solution to this? I mean fighting spam is one thing, but currently a team of people randomly fighting spam isn't gonna go very far.
What do we have in the automated spam fighting arsenal?
Also, as for SEO, would interconnected wikis have the same effect as linking from other domains?
As I understand - spam is always following the same "layout":
Wikidot links to wikidot sites are very seldom and as i understood - not really the sign of spam..
Service is my success. My webtips:www.blender.org (Open source), Wikidot-Handbook.
Sie können fragen und mitwirken in der deutschsprachigen » User-Gemeinschaft für WikidotNutzer oder
im deutschen » Wikidot Handbuch ?
Thank you for sharing this information about spam on wikidot. I am a teache at a middle school and we have a discussion about spam on the internet in general. I will share this with them.
Not a good idea to write here about the arsenal… :))
But as you can see in my post before - the layout is easy to detect and can be fight against them very easy.
Spam-posters ( or users changing old wikis by inserting their links) are a little bit more difficult to fight, - but we are doing this - if we get knowledge from them! ( means - they have no spam site build but work on other open sites).
I hope the "abusive" messaging system will help one day us..
Service is my success. My webtips:www.blender.org (Open source), Wikidot-Handbook.
Sie können fragen und mitwirken in der deutschsprachigen » User-Gemeinschaft für WikidotNutzer oder
im deutschen » Wikidot Handbuch ?
We are constantly watching the tools that we know that can generate content on Wikidot and we try to block them. This eliminated about 90% of spam sites. These tools have algorithms that are updated every few weeks by their developers, so I believe this will not be an easy game.
Another thing is abuse from real people, which we will address in the nearest future. Right now we are responding to individual claims and act accordingly, but there will be automated tools to report and handle individual users too.
Michał Frąckowiak @ Wikidot Inc.
Visit my blog at michalf.me
Thanks for the "abuse" info !
Now I can wait…
Service is my success. My webtips:www.blender.org (Open source), Wikidot-Handbook.
Sie können fragen und mitwirken in der deutschsprachigen » User-Gemeinschaft für WikidotNutzer oder
im deutschen » Wikidot Handbuch ?
Excellent, I'll be looking forward to doing some spam hunting. I'm glad 90% of spam sites are easy to take care of.
omg why dose everyone hate spammeres?
lol
Irony :D
~ Leiger - Wikidot Community Admin - Volunteer
Wikidot: Official Documentation | Wikidot Discord server | NEW: Wikiroo, backup tool (in development)