×

Welcome to the Slashdot Beta site -- learn more here. Use the link in the footer or click here to return to the Classic version of Slashdot.

Thank you!

Before you choose to head back to the Classic look of the site, we'd appreciate it if you share your thoughts on the Beta; your feedback is what drives our ongoing development.

Beta is different and we value you taking the time to try it out. Please take a look at the changes we've made in Beta and  learn more about it. Thanks for reading, and for making the site better!

Cornell Software Fingers Fake Online Reviews

Soulskill posted more than 2 years ago | from the pulling-back-the-curtain dept.

Advertising 122

Eric Smalley writes "If you're like most people, you give yourself high ratings when it comes to figuring out when someone's trying to con you. Problem is, most people aren't actually good at it — at least as far as detecting fake positive consumer reviews. Fortunately, technology is poised to make up for this all-too-human failing. Cornell University researchers have developed software that they say can detect fake reviews (PDF)."

cancel ×
This is a preview of your comment

No Comment Title Entered

Anonymous Coward 1 minute ago

No Comment Entered

122 comments

First Review? (5, Funny)

kimvette (919543) | more than 2 years ago | (#36889438)

This topic is TOPS! It is a beautiful summary!!! I highly recommend it!!!

Re:First Review? (-1)

Anonymous Coward | more than 2 years ago | (#36889528)

fuck you cunt. go eat some more shit.

Re:First Review? (0)

Anonymous Coward | more than 2 years ago | (#36889752)

I apologize for my outburst, I am a turd-burgling douchebag.

Re:First Review? (0)

Anonymous Coward | more than 2 years ago | (#36889668)

Both sample reviews seem fake, as they both lack any real details to back up the allegations of praise.

Re:First Review? (1)

outsider007 (115534) | more than 2 years ago | (#36889778)

The title needs work. I spent about 15 seconds wondering what a "software finger" is.

Re:First Review? (1)

RockDoctor (15477) | more than 2 years ago | (#36891612)

If you didn't think of teledildonics, then you can queue up with the AL-76 deniers [slashdot.org] to hand your geek card in.

"Come on, chop chop. We haven't got all day you know."

Re:First Review? (0)

Anonymous Coward | more than 2 years ago | (#36891976)

The title needs work. I spent about 15 seconds wondering what a "software finger" is.

FINGER outsider007@slashdot.org

Nice. (1)

Anonymous Coward | more than 2 years ago | (#36889442)

They also gave hints on how to defeat it.

power (0)

jamesh (87723) | more than 2 years ago | (#36889462)

if (review == negative && product_made_by == someone_we_received_cash_from)
    review_fake = true
   

Re:power (0)

Anonymous Coward | more than 2 years ago | (#36889632)

if (review == negative && product_made_by == someone_we_received_cash_from)

    review_fake = true;

 

TFTFY

Re:power (1)

jamesh (87723) | more than 2 years ago | (#36889810)

Thanks. I was wondering why it didn't compile.

Re:power (1)

CrazyDuke (529195) | more than 2 years ago | (#36890156)

Ship it anyway: We'll just buy some good buzz so it sells. You can fix it when the support calls come in.

Hugs and Kisses;

The Marketing Department

P.S. Your supervisor will be calling you shortly.

Re:power (0)

FrootLoops (1817694) | more than 2 years ago | (#36889762)

I'm confused. Shouldn't it be review == positive?

Re:power (0)

Anonymous Coward | more than 2 years ago | (#36889834)

Since these aren't set to strings or literal strings they are set to other variables and thus we have no idea what they are being checked against. For all we know negative could equal positive earlier in the code.

Re:power (1, Informative)

Dunbal (464142) | more than 2 years ago | (#36889922)

You want good reviews from people you received cash from to be declared fake by your algorithm? Don't quit your day job...

Re:power (1)

Flush1 (2356344) | more than 2 years ago | (#36890122)

Umm i believe that logic equation means if someone elses review is negative..and that product is made by a company whom paid the algorithm creator money...its default fake...duh. as in it only claims fake review so that the negative review is illegitamate? L2read:)

Re:power (1)

Plombo (1914028) | more than 2 years ago | (#36890462)

The equation in the original post says that, but the post he replied to (incorrectly) says the equation should be different.

Re:power (1)

FrootLoops (1817694) | more than 2 years ago | (#36891026)

I see now. I misread "they" for "me", so I interpreted the joke from the perspective of lazy scientists instead of unscrupulous scientists. For instance, the following might be a lazy scientist's code:

if (review == positive && product_made_by == someone_they_received_cash_from)

  • review_fake = true

read negative ones? (0)

Anonymous Coward | more than 2 years ago | (#36889508)

I prefer searching for negative reviews to find out what kind of problems or weak points I can expect. Then I can see whether the product has any real flaws (or whether the reviews were just written by idiots who cannot unpack/install/operate the thing). All the positives are already presented by the producer, anyway.

Re:read negative ones? (2, Insightful)

hedwards (940851) | more than 2 years ago | (#36889542)

What about fake reviews that are posted by the competition. I have a hard time believing that anybody that is posting fake reviews of their products isn't doing that for their competition as well.

Ultimately, I tend to look for the reviews that are the most informative, things that look plausible and give me more information than what's in the listing. Usually those are fairly reliable as they're harder to fake. Not that it's a perfect system, but it is more time consuming to post a review like that since you really have to do different ones for different sites.

Re:read negative ones? (1)

0100010001010011 (652467) | more than 2 years ago | (#36889826)

Anyone with an IQ over 100 can filter stuff. I was looking for a particular camera and all of the 'negative' reviews were people that expected it to come with more than a 32MB SD card or AA batteries. They were utterly crushed when their "christmas was ruined" because of these details. That or people that had a problem with Amazon and had no fault of the product itself.

There were a core group of middle of the pack reviews that touched on all the positives and negatives and then the praising reviews that may have been real, but gave no real information about the product. "CAME in 2 dAYS! Thanks amazon, can't wait to try this out!"

Re:read negative ones? (3, Informative)

Anonymous Coward | more than 2 years ago | (#36890132)

Not the GP here, different AC who mostly agrees with him. I also agree with you re: informative stuff. Both filters are useful alone, better in concert.

What about fake reviews that are posted by the competition. I have a hard time believing that anybody that is posting fake reviews of their products isn't doing that for their competition as well.

It's simple economics. You spend your review-spamming money where you get the best ROI.

If I post a positive review for my product, I get all the gains, while the loss of sales is distributed over all my competitors _and_ the null competitor, (i.e. people who wouldn't have purchased anything but for my review).

If I post a single negative review to a competitor, he takes all the loss, while the gains are distributed over all my other competitors and me and the null competitor (people who would have bought from my competitor, but now don't buy at all).

So in a case where there's me and one other competitor, and assuming equal influence of positive and negative reviews, positive reviews are slightly better (because they pull customers in, rather than putting them off entirely). Equal influence is bullshit. of course; if my competitor is larger, a negative review there will be seen by more people, so more effective, and many people do have a skeptical bias (as recommended by GP and seconded by me), so negative reviews will have more influence. This means in a two-seller market, negative reviewing likely is viable.

Still, if there's a "sufficient" number of competitors (depending on exact influence levels), I'm obviously going to see much more benefit per review from positively reviewing my own than negatively reviewing competitors. Now there's diminishing returns with more fake reviews for myself, so at some point a negative campaign will be better ROI than further expansion of my positive campaign; I personally suspect other advertising techniques will have better ROI, so you'll likely never get to that point, but that's just a hunch. I wouldn't go as far as to suggest negative reviewing has negative ROI, so it's still quite possible if you have ridiculous advertising budget and have exhausted all higher-ROI approaches, it's just not prevalent in practice.

Re:read negative ones? (1)

Anonymous Coward | more than 2 years ago | (#36890936)

Economics does not trump morality and ethics.

Re:read negative ones? (4, Interesting)

PopeRatzo (965947) | more than 2 years ago | (#36890216)

What about fake reviews that are posted by the competition. I have a hard time believing that anybody that is posting fake reviews of their products isn't doing that for their competition as well.

That's why I appreciate Amazon's "verified purchaser" or whatever it's called. When a review is posted by someone who actually bought the product from Amazon, it shows up beneath the title of the review. By only looking at those, I'm able to eliminate a lot of the junk reviews. Now, nothing stops the competition from actually buying the product and then trashing it, but I can also look up other reviews by that reviewer. This gives me very good insight into the way that person thinks.

I suppose nothing stops a phony from creating an Amazon review, buying a bunch of products and then buying the product he intends to trash with a bad review. But I figure that's not really likely. And I could probably figure it out by reading their previous reviews anyway.

Re:read negative ones? (1)

hairyfeet (841228) | more than 2 years ago | (#36891520)

That is why I look for the MOR reviews which it sounds like you do too. The ones that say its the greatest and the ones that say its a turd don't really give me any info so I look for the average Joe that you can tell by reading has used the thing.

For an example the review I read on Amazon for the Zoom bass pedal I ended up buying I found informative went like this: "Sounds are good as long as you don't go overboard with the effects, low noise but a few of the effects are just cheese, drum machine isn't gonna beat a dedicated machine but does keep a straight beat, whammy can be assigned to any effect. As long as you don't stomp the thing and try to use more than a couple of effects at a time it works good".

With that the guy gave me all I needed to know, don't go nuts with it, sound is decent as long as you don't overload the chips, and pedal is sturdy if not Doc Martin proof. He didn't act like it was the greatest nor garbage, just a nice general overview of what to expect. I bought the pedal and loved it.

So for me I've found just stick with the MOR and it all works out. If the review has tons of praise without any real nigglers? Most likely fake as anybody can find things they wish were different. By the same token those that find nothing but things wrong usually don't know how to use the thing and take their frustrations out on the review. So stick with the average guy MOR review and usually you're good to go.

Re:read negative ones? (-1, Flamebait)

Alex Belits (437) | more than 2 years ago | (#36892888)

Oh, wow!

(famous karma whore and Microsoft astroturfer hairyfeet at work).

Re:read negative ones? (0)

hairyfeet (841228) | more than 2 years ago | (#36893092)

Oh wow, proof that from the very beginning /. had total whackjobs! And I noticed you are TOO SCARED to post anymore unless it has left the front page. Whats the matter Alex, karma starting to suck? I guess we "super sekret M$ ninjas" smack the shit out of little blankie huggers like you. But since you like being cock slapped by the truth so much, as a public service I show your failure yet again! Enjoy!

Isn't it sad, how like a frightened child afraid to look under the bed, you cower at the truth? if your driver model isn't shit then why does Dell have to run their own repos [theinquirer.net] even though we are talking a teeny tiny subset of hardware? Oh right because Linux shits itself and dies if you use the default repos! Man that is some excellent product you got there! you think I can get better QA than the third largest OEM on the planet? What, you expect me to tell paying customers "Go to the forum, kiss some loser ass, and maybe, just maybe, in a few days someone will have mercy and give you a big pile of bullshit that may or may not make your sound work again"?

Bleeding yet douchey? want some more? nice thing about having the truth on your side, you can keep throwing punches all day! How about how a decade old Windows beat the shit out of Linux on netbooks [computerworld.com] or how ASUS has given up on your bullshit [computerworld.com.au] or how about Walmart running away from linux as fast as it can [pcworld.com] ? You got the crazy koolaid drunk enough to say they ALL are paid shills because they won't do your forum dance or CLI horseshit? Meanwhile your "hero" Torvalds the great says Plans? We don't need no steenkin plans! [kerneltrap.org] . Why don't you tell them that at work next week, see how quick you get a pink slip? More? How about you actually have the balls to celebrate getting a whole 1% market share [slashdot.org] while you are actually lower than JavaME [netmarketshare.com] and there is a whole website dedicated To your bullshit and excuses [tmrepository.com] .

So you go hide now mama's boy, you hide with your Tux blankie and keep saying your magical nigger nigger faggot, or should I say shill shill astroturfer, like it is a magical word that will make all the bad go away. But it won't change reality and the reality is your driver model is shit and more than 15 years behind everyone else and that is why retailers like me wouldn't piss on it, not some mythical money truck that sneaks up to my door in the middle of the night. So go compile something and leave the men to talk about the real world, okay little girl?

I'm apparently pretty good at rating myself (0)

mrxak (727974) | more than 2 years ago | (#36889518)

I picked out the fake review immediately.

Re:I'm apparently pretty good at rating myself (1)

kimvette (919543) | more than 2 years ago | (#36889538)

I did too! It's not hard to spot fake reviews!! I'll be sure to spot more in the future!

It's easy - fake reviews are overly-enthusiastic, and some of them go as far as to slam other brands. Real positive reviews are usually more sedate, little over-use of exclamation points!! and usually point out shortcomings of a product. Also, companies who astroturf usually submit multiple reviews, and it's usually posted in the same wording and typing style, which makes the fake reviews stick out even more. That's why when shopping for high ticket items I tend to read the negative reviews as well, and pay particular attention to longer reviews since fewer astroturfers invest the time in complete reviews.

Re:I'm apparently pretty good at rating myself (1)

v1 (525388) | more than 2 years ago | (#36889756)

fewer astroturfers invest the time in complete reviews

I look for reviews that include both positives and negatives. Nothing is perfect, and most good reviewers will find at least one drawback or limitation in the object being reviewed. Reviews that are nothing but positives I don't give a lot of credit to - eve if they are real, they're probably not being objective.

I know anytime I write a review, I give a quick breakdown, hit the positives, hit the negatives, and close with a summary. (a lot of professional review sites, sites that review a large number of entrants in a particular field, do the same, look at for example independent hard drive reviews) I wish more others would do the same.

Re:I'm apparently pretty good at rating myself (4, Insightful)

pipedwho (1174327) | more than 2 years ago | (#36890040)

If I was being to paid to astroturf a product, I'd prepare a number of generally positive and a few 'negative' reviews that pointed out a few flaws in the product. Of course those would only be flaws that the majority of people will either not care about, or will see as positive to themselves. The idea is to seed a small element of trust in the product, and take away the feeling of blind risk from the potential customer.

In some of those reviews I'd also mention another product or two that I felt were 'better', again only in some specific way that most people wouldn't care about. This seeds an element of legitimacy to the product, especially when comparing it against known good competition. The idea is not to get 100% of people thinking your product is the best, but to catch a large number of customers that would have otherwise never even considered your product.

The third sneaky thing that I'd do would be to review a competing product or two with a very minor mention of the product I'm being paid to astroturf. In that review I'd be generally positive, while at the same time throwing in a few questions that seeded some doubt and uncertainty about some seemingly important aspect of the competitor's product that my actual product reviews (and legitimate advertisements) had covered as being fully supported. In this way, the person 'researching' the general class of product is likely to do some further research into 'my' products - specifically searching for these 'missing' or 'doubtful' aspects that I've alluded to.

The above tactics are readily seen across the board in general advertisements where a company will harp on about some new 'feature' that they have - especially a feature that competing products don't officially advertise or mention - thus implying that the feature does not (or may not) exist in those other products. In reality the feature is a straw man style argument that compares apples/oranges in a way that less than 10% of the potential market would see as an invalid or incomplete comparison.

How does anyone know that there aren't people out there readily using any or all of the above tactics?

There are (0)

Anonymous Coward | more than 2 years ago | (#36890272)

There are, what took you a few minutes to write into a post has been a staple of astroturfing and smear PR for years. Have you seen the stories about Google having bad privacy with the 1st comment on slashdot reading exactly like you just described? They have subsided as of late (maybe because Google+ is generating so much news both good and bad they dont need to) but I'm sure they will be back. They are paid and persistent. Dont believe me? Facebook admitted they were doing this. Hired the same PR firm as MS. MS is an investor in FB. Look it up -- be informed.

Re:I'm apparently pretty good at rating myself (2)

symbolset (646467) | more than 2 years ago | (#36890766)

These are effective strategies that have been in use and working for some time. There are a few refinements the past decade. People often skip the middle of the review or zone out in the middle. So when you're 'turfing a product with fatal flaws like for example a phone that can't multitask, has no apps and can't even set your "I like big butts" MP3 as a ringtone for your amply so endowed love interest like other phones can, that's a good spot to pretend those slights don't exist and instead go on about some minor flaw that absolutely nobody could care about before dismissing it as a minor issue not worthy of subtracting a star.

For the most part they've given up using the ESL contingent from Bangalore and Costa Rica for the astroturfing campaigns. They gave a lot of column inch per dollar, but just weren't persuasive. They couldn't tell when they were being played, they weren't aware of context. They would just argue away, pasting their talking points into a dialog with someone who understood what was going on without a care how it looked to the audience in general. The new ones would just paste the script verbatim as if it was a trump card and blow everybody else's chance at subtlety. It was a negative return on investment. It took so much more investment in psych majors to build up decent arguments than the 'turfers cost to post them, and then the 'turfers just ruined it with poor delivery. So now they just hire the psych majors I think. And prisoners. Lots of Arizona prisoners.

I think they're investing more in poisoning before. If a venue isn't generally supportive they might spend some considerable effort making the entire site unsavory, or picking apart established players in order to diminish their interest in the site. Griefer is probably the most advanced form of 'turfer out there today - and I don't mean goatse guy - he's a legitimate researcher into captcha defeat technologies.

There are even absurd parodies of fans of products in play. They gush adoration for minor features at every opportunity but never mention prime benefits and dismiss (but never fail to mention) major shortcomings as trivial. They creatively destroy their credibility with every post to create a positive impression of what they criticize and a negative impression of what they praise. They're the marketing version of getting your idiot cousin on your competitor's payroll. This rabbit hole goes much further than you've considered.

Re:I'm apparently pretty good at rating myself (1)

pipedwho (1174327) | more than 2 years ago | (#36890942)

So when you're 'turfing a product with fatal flaws like for example a phone that can't multitask, has no apps and can't even set your "I like big butts" MP3 as a ringtone for your amply so endowed love interest like other phones can, that's a good spot to pretend those slights don't exist and instead go on about some minor flaw that absolutely nobody could care about before dismissing it as a minor issue not worthy of subtracting a star.

It's interesting you point out well known issues in the original iPhone that you feel are 'fatal flaws' in one of the most successful single products on the market at the time. By extension of its success, I'd say those features are were significantly less important to a huge majority of Apple's target audience, and were in fact the minor and not the major flaws.

Now imagine that Apple's advertising agency had a number of astro-turfers out there specifically seeding those 'flaws' into general discussion along with some overriding positives. Those that latch onto these 'problems' as being significant to them are effectively no longer Apple's target market. Assuming that group is a small enough percentage, the rhetoric that is generated by the ensuing discussions is more likely to push their target demographic more strongly into a purchase. It also polarises a market that may have previously been sluggish to adopt new technologies.

If I see a review and the 'major problems' list a bunch of things that I don't care about. Not only does the review appear balanced, but it ends up in fact being overtly positive of the product, irrespective of how many 'stars' are given.

Re:I'm apparently pretty good at rating myself (1)

symbolset (646467) | more than 2 years ago | (#36891440)

Congratulations - you've outed yourself. You're who we're talking about. That wasn't hard. For your sake I hope this is a throwaway account. I've friended you here and I hope all my friends will too, so we can see the nonsense you post. Now that you're stuck in it, do you see the trap? In hindsight it should be obvious. Those were features iPhone lacked about a billion phones ago, when they faced competition that didn't have those features, or lacked other critical features iPhone did have. They're also features WP7 launched lacking that both iPhone and Android had when WP7 launched. You detected that and sensed you needed to defend your platform without understanding either the temporal context or who you're talking to. You lose. You're exactly who we're talking about. You know your job is to defend your platform, but you lack both context and art. You don't even mention WP7 in your post but by your derogatory remarks you hope to sway, and you can't because temporality prevents it.

When gas is four bucks a gallon fuel efficiency is going to move a lot of cars and American Muscle Cars are a premium item rather than a mass market item. If your job is to move Chevys then your job is to emphasize the luxury of the experience, not the cubic inches that burn fuel. When phones that alert you to who is calling by the ringtone MP3 you've associated with the caller is the standard form then phones that lack that feature are in the bargain bin and you need to draw focus on other things if moving those bargain bin phones is your job. It's not your job to point out that in years past different people focused on different things. To attempt to come to market with such a thing is a fool's game. That's not your fault because you're in Marketing rather than Engineering. The lack of the feature is an Engineering fail. But that you felt the need to come here in this context, reach so far to defend your product and not realize you're out of your depth, that's a Marketing fail. You guys really suck on every level. No wonder you're finding new lows in morale [blogspot.com] every quarter. Your final line's attempt to become reasonable isn't enough.

Now that you've burned this account for me, I may as well give you a little back. The whole "Apple is mindbending" thing isn't working. You know what? I don't aspire to Apple products and I'm not going to, but I would be flat stupid to try to pretend that others don't. I don't care for them because their Cathedral doesn't appeal to me. I prefer the Bazaar of Android. The others that do? I wouldn't alienate them by calling them stupid. They like different things than me. They have different needs is all. iProducts are good gear. I've walked around with an iPad, and complete strangers felt the need to strike up conversation and see the thing. Apple products just don't suit me because I demand to be the master of my gear. If you don't have that issue, they have iMovie and GarageBand, which is a great deal for what you get. I knew I was giving that up when I bought my Asus Transformer and I'm OK with that because it's got microSDHC, and it obeys me above all.

Do you see what you've done now? Do you have any clue at all? Is your supervisor looking on? Maybe he can explain it to you.

It's hilarious to watch you all fail so spectacularly and so predictably. Do you have any idea how entertaining your failure is? If not failing weren't so freaking obvious it wouldn't be as funny.

Re:I'm apparently pretty good at rating myself (1)

pipedwho (1174327) | more than 2 years ago | (#36891750)

Dude, feel free to hate Apple. And hate me too if you want.

But, I have no affiliations with Apple, Microsoft, Google, etc, and I don't work in marketing or advertising.

Yeah, WM7 phones had the same issues at launch, but I used the original iPhone as a counter-example because history has shown that at the time it was incredibly successful despite those things that you claim are major flaws. Those were all issues that were regularly echoed in this forum and on many other internet blogs and boards. Yet, people still bought this new at the time product. Whether or not you or I think the product was any good, the original iPhone was an enormous marketing success.

dreadnoughts of Amazonia (1)

epine (68316) | more than 2 years ago | (#36890778)

Flawless astroturf is indistinguishable from hard work. It's certainly possible, but is it actually cheaper than not making a crap product in the first place? The makers of flawless astroturf are unlikely to be employed by Motel 69. I've heard it presently costs somewhere north of $500m to get a new drug approved by the FDA. The dreadnoughts of Amazonia are overstated.

I've argued several times recently for the virtues of pseudonymous pluripotency and against the consolidated identity of Google+. But then, I don't besmirch my pseudonymous splendour with motel reviews. (I fear my gig could be busted on a measure of bifurcated alliteration; but for the moment, writing such a filter is--you guessed it--indistinguishable from hard work.)

When you think about it, this is the Turing test in miniature. In the samples given, the straight man on the left is the easier text type to mimic flawlessly than the gusher on the right; the difference is that the gushy cake mix is more likely (I presume) to influence consumers with poor impulse control, so the fakers helped themselves to a giant box of Woody Allen instant pudding.

I picked both samples as fake. The sample on the left doesn't pass for anything more clever than a really long paper tape with heart-felt opinions on infinite spools; the sample on the right doesn't pass any test.

The last book I purchased with recourse to the Amazon rabble was The Elements of Statistical Learning [stanford.edu] .

The review that finally sold me was the guy who said, "whenever I get into real trouble, this is the first book I crack open". He was saying that there was plenty of depth between the lines, for the reader willing to struggle. Any large book I'm going to lug around in the physical world had better come equipped with more lifelines than the 2nd Titanic.

I also bought an introduction to VHDL programming at the same time (Amazon now has me narrowed down to a few dozen meatspace puppets) that was precisely the opposite: a quick bootstrap with nothing whatsoever to recommend a third reading. For the price, I was disappointed. Perhaps it paid for itself on the first reading; even if it did, it was a soulless experience.

It's not that everyone wants convenience. It's more the case that most large companies want consumers who want convenience. Convenience is a sound people make while opening their wallets knowing that they skipped out on proper evaluation.

Competence is indistinguishable from hard work. When I do read reviews, I tend to scan *every* review, not just the five (most helpful to Amazon) that they offer up for one click less. While my eyes are skimming madly for dialtone in the morass of pseudo-babble, my brain is consolidating in background the few useful sentences, pro against con. The brain is good at PCA if you give it a chance.

Re:dreadnoughts of Amazonia (1)

epine (68316) | more than 2 years ago | (#36890986)

The Slashdot comic-box gods are on to me:

How sharper than a serpent's tooth is a sister's "See?" -- Linus Van Pelt

One instance of the word "sample" in my post above could perhaps been rendered as "wind-up" instead, rife with puns and elisions ... and Charlie Brown's pitching elbow. Makes for a bad sentence. The sibilants of Spain are mainly the same. Is that a linguistic fact? I wonder.

Re:I'm apparently pretty good at rating myself (0)

Dthief (1700318) | more than 2 years ago | (#36889556)

yes, because no one used the hotel name at end of sentence in the review...it was a bad example

Re:I'm apparently pretty good at rating myself (1)

Richard Dick Head (803293) | more than 2 years ago | (#36889608)

FYI, The article is wrong, both are fake. Its in an article, duh. If it has too promotional of a tone, if there are buzzwords. If the spelling and grammar is too perfect.

Oh yeah...honest reviews of sufficient length always have unrelated details. Some promotional slob in an office somewhere isn't going to go off topic. Ya know, crap like "I treated my self to the Sopranos when I stayed there!". or "The maid was hot"

So, if you're like me, and into writing fake reviews...(yeah yeah, I know). don't capitalize, add useless details, and add criticisms no one would care about, like "I thought the hotel soap was a little fruity, but lucky I brought my own". Ya know.

Re:I'm apparently pretty good at rating myself (1)

Anonymous Coward | more than 2 years ago | (#36890286)

Now they have to make it to recognize fake profiles in dating sites (grin)

Re:I'm apparently pretty good at rating myself (0)

Anonymous Coward | more than 2 years ago | (#36890848)

Me too!! I'm totally not lying! Honestly I'm great at figuring out fake reviews!!

I found a decent use (0)

Anonymous Coward | more than 2 years ago | (#36889540)

good, I'll use it on the crappy book reviews/ads prevalent on this site.

Re:I found a decent use (0)

Anonymous Coward | more than 2 years ago | (#36889692)

if (book_publisher == Packt && book_reviewer == RickJWagner)
{
        shill_review = true;
}

Stupid project (1)

oldhack (1037484) | more than 2 years ago | (#36889546)

It's an "undecidable" problem. Think for a moment how you'd define "fake".

Re:Stupid project (0)

Warlord88 (1065794) | more than 2 years ago | (#36889604)

It includes reviews by anyone who has never used the product. Example, this Zenith watch [amazon.com] . I won't debate the hilarity of the reviews, but no doubt they are fake.

I think the "undecidability" factor comes into play in any machine learning problem. For example, which email is spam and which isn't? But significant strides have been made to solve that problem and I don't see why online review system is any different.

Re:Stupid project (0)

Anonymous Coward | more than 2 years ago | (#36889764)

AFAIK you can review on Amazon, unless you've actually purchased the product.

Re:Stupid project - this is Spam! (1)

Kernel Krumpit (1912708) | more than 2 years ago | (#36890582)

This is Spam! Citi, on behalf of Sears, has decided to spam me daily with notifications of my balance due. This despite my "opt-in" to be to be notified monthly and the fact that my "opt-in" request was working "once a month" until last week. And, No. I am not overdue, late, in arrears or in any other negative Citi space! I did bring this spam to Citi's attention. They replied that my email was forwarded to "someone who doesn't give a flying fuck" although, not in so many words! And, the next "higher-up the food chainer" hasn't replied with substantive apologies or solutions at all. As usual, Citi doesn't give a flying fuck about the individual. I shall have to report this as Spam and hope they hit the SORBS list. Please, use "Spamgrabber" with your Outlook 2007/10 email client and report ALL Spam from your financial institutions. Who cares if it isn't clearly Spam? Just use the principle of "Balanced Reciprocity"! I have no idea, for those using other email clients, how you easily report Spam without an add-in like this ??.

Re:Stupid project (0)

Anonymous Coward | more than 2 years ago | (#36891938)

shit . i spilled my coffee

Re:Stupid project (1)

wiedzmin (1269816) | more than 2 years ago | (#36889726)

I think it incorrectly states "fake" where it should really say "automated".

Re:Stupid project (1)

ironjaw33 (1645357) | more than 2 years ago | (#36890252)

I think it incorrectly states "fake" where it should really say "automated".

I would say that it's more of a conflict of interest than fake or automated. The reviewer may be a real person and he or she may have actually owned/consumed/used the product being reviewed. The issue is that the reviewer is in the employ of the product manufacturer or marketing agency hired by the manufacturer.

ob (0)

Anonymous Coward | more than 2 years ago | (#36889552)

As soon as I walked down the street holding a print-out of this PDF research paper, women were immediately attracted to me.

It works... (1)

turkeyfeathers (843622) | more than 2 years ago | (#36889574)

They tested it on Slashdot's Packt book reviews!

Re:It works... (0)

Anonymous Coward | more than 2 years ago | (#36889660)

They tested it on Slashdot's Packt book reviews!

Yes, and then come the hordes of slashdot comment posters to rip the whole review into pieces.

Link to the paper (2)

kabloom (755503) | more than 2 years ago | (#36889580)

I think you want the link for the paper [aclweb.org] , rather than the slides.

Re:Link to the paper (0)

Anonymous Coward | more than 2 years ago | (#36889808)

Yes i do.
Thanks.

Re:Link to the paper (1)

uofitorn (804157) | more than 2 years ago | (#36890406)

If you are one of the millions suffering from subluxation a slide show would be the least of your concerns.

How can you tell a review is fake? (0)

Anonymous Coward | more than 2 years ago | (#36889586)

Q: How do you tell a review is fake?

A: There's text on the screen.

Arms race? (1)

davidwr (791652) | more than 2 years ago | (#36889596)

If this catches on it will just make the fake-reviewers work harder, but it won't, by itself, stop them.

Reputation-based reviews are probably coming. Of course, it's possible to create a fake reputation if you plan ahead of time.

Re:Arms race? (0)

Anonymous Coward | more than 2 years ago | (#36889642)

If the fake reviewers get their hands on the tool, then they can run their fake reviews through the tool and refine the review until it seems genuine.

The one on the right is fake or flake (1)

davidwr (791652) | more than 2 years ago | (#36889640)

The bubbly-over-the-top sound of the review on the right screamed "this is not the opinion of a person exercising sober judgment."

So, even if it wasn't a fake it wouldn't be useful.

The one on the right is formulaic enough that it *could* be fake, so I would need to rely on the reputation of the author or publisher. If I saw it in a major newspaper's web site with a byline of a newspaper employee or a reputable wire service, I would assume it was legit. If I found it on some random blog or a web site where anyone can post anything, I wouldn't be as likely give it the benefit of the doubt unless the author had a good reputation.

way to solve fake reviews (0)

Anonymous Coward | more than 2 years ago | (#36889650)

you get caught we cut your head off mount it on a pike and take pics and send to all marketing companies world wide.

PROBLEM WILL then solve.....

Re:way to solve fake reviews (0)

JustOK (667959) | more than 2 years ago | (#36889680)

well, don't use the Ringblat 330x camera to take the pictures. I heard they are not very reliable. Try the new ZoxRoc Giggity-Pixel Extreme for super best results.

Negative reviews (0)

Dachannien (617929) | more than 2 years ago | (#36889664)

This is why I look at the negative reviews first to see if there are any particularly frequent problems with the product.

Of course, a few years ago when I was apartment shopping online, I found that this tactic doesn't always work so well. On one side, you have the management companies posting shill positive reviews for their apartments, and on the other side, you have disgruntled evicted tenants posting overblown negative reviews for those apartments.

Just like Slashdot (1)

PPH (736903) | more than 2 years ago | (#36890310)

and on the other side, you have disgruntled evicted tenants posting overblown negative reviews for those apartments.

All they do is gripe about crappy Windows.

Cornell Software Fingers Fake Online Reviews (1)

Anonymous Coward | more than 2 years ago | (#36889782)

I've seen enough hentai to know where this is going.

Mary Jane Rottencrotch (0)

Anonymous Coward | more than 2 years ago | (#36889920)

...through her pretty pink panties.

Seriously, that headline is a little quizzical. A split-second after I got my mind out of the gutter, for half a moment I was under the impression that this was an article about simulations of robotic fingers literally (or would that be virtually?) pointing at advertisements.

I write these (0)

Anonymous Coward | more than 2 years ago | (#36890086)

I write fake reviews, and I really appreciate all of your pointers on what you see in a fake review. We usually have 2 to 3 people writing reviews on a product at a time so writing styles don't repeat. We also sometimes write negative reviews on competitor products, but that's done "under the table," as they say. It's not encouraged officially, but it's certainly not prohibited. Managers do see these from time to time, though; and I think it improves your status here. Marketing is a pretty cut throat business.

Lets be realistic.... (2)

joocemann (1273720) | more than 2 years ago | (#36890422)

... what we know is that this is just another form of information security.

The people who produce false reviews will develop a tool that not only fakes the reviews, but then applies this exact software (in the article) to analyze it, and then provides logical adjustments until this exact software cannot discern the difference between the adjusted outcome or real reviews.

All these cold wars suck. A little honesty and integrity in the world would be great, but when capitalism pits us against each other to survive (not for wants, but for needs), this is exactly what you should expect. I prefer cooperation over competition, when it comes to survival, but if the social environment dictates that I must do bad to survive, I must survive.

If you respond, please don't be the shallow minded bum that thinks there isn't a causal relationship between what I just said and how people fake reviews (for revenue).

Re:Lets be realistic.... (1)

wrook (134116) | more than 2 years ago | (#36891212)

when capitalism pits us against each other to survive (not for wants, but for needs)

http://en.wikipedia.org/wiki/Fundamental_human_needs [wikipedia.org] puts this statement in context. I can sympathise with your feelings, but in a 1st world country, the items on this list are available in abundance. It is true that there are some people who are unable to take advantage of this abundance due to mental illness and the like, but I don't agree that competition for resources is a large factor.

Rather, I think that perhaps rampant consumerism couches our wants in terms of needs. We follow a logical fallacy where I need X to get Y and hence think that X is a need. But if Y is a want, then X is likewise unnecessary for survival, no matter how desirable it may be. We have created social structures in which it is unacceptable to have less than the people around you, or less than your parents had before you. This is not related to capitalism. It is consumerism.

The easiest way to escape consumerism is simply not to play that silly game. Get a humble job with a salary that meets your needs. Never, ever, ever borrow money. Realise that anything above your needs is luxury. Revel in your newly found wealth. Note: this only works in 1st world countries where we live ridiculously abundant lives without realising it. For people who live in places where they *actually* struggle to live because of a lack of resources, you probably *do* have to compete to survive.

Re:Lets be realistic.... (1)

joocemann (1273720) | more than 2 years ago | (#36891450)

I wish I had time to respond in full, but I don't right now (pretty busy with life, sorry about that because you deserve more from me).

But what I can say is that the needs I'm talking about are absolutely realistic, encompassing the complexity of society as it exists today and the intricacies that induce participation in competitive roles to fulfill needs. I could brainstorm many points in the fundamental human needs you posted that are not available by social means, especially once one considers relative differences in individuals -- when you take individuals into consideration, one must exercise sympathy in their analysis of what is possible because this is reality, not some utopia where we can assume all people had proper parenting, psychology, and education through their upbringing. We have total buffoons that cannot think around a problem that you or I might do readily -- and yet they are real, and many will echo their limitations through their own progeny.

My point being that, no, our needs are not met by social means, and capitalism *has* pit us against each other for our needs; and even beyond that, if our absolutely realistic structure of society forces people to perceive 'better things' as 'needs', what's the difference? The *reality* is that many will perceive a car as a need (though I would argue that current societal structures in the US almost absolutely require personal vehicles as needs because of the poor design that we live in), even if they could ride a bike or walk. At that point you should be fully in support of expanded social education, to cover the need for people to understand the truth behind what is and isn't an actual need -- the point being that if you wish to achieve a global understanding of needs that are not simply memetic-wants, you will NEED more education that will not arise without social input (aka not spontaneously or by capital gains means).

Maybe I'll find some more time to expand on this with you. I urge you to brainstorm from the list you provided and consider those needs and how some are only achieved by the money that mediates and is sourced by some form of obligate labor (mental or physical).

An example: Your landlord neglected the black mold in your walls that is getting you sick because he gave his daughter 10k (for chemo for her daughter) and can't afford the expensive mold removal. He screws you, but not from malice, only to provide the Protection(care) that is a need on that very list and is not available socially. (Yes, I realize maybe this didn't happen to you, but its a real world example demonstrating how capitalism can pit us against each other.)

Re:Lets be realistic.... (0)

Anonymous Coward | more than 2 years ago | (#36893146)

I protest against your use of the word "capitalism" without qualification, even as I agree with everything else in your post. Capitalism on an agrarian level or with the right kind of government regulation would be beneficial for all. It would scale "wants" based on disposable income, but "needs" based on ...need. The real monster that is hiding between the lines in this story of astroturfing is that of a sham economy:

The typical product hyped by astroturf is a low- or no-quality product, shipped overseas, produced by people who receive a miniscule share of the profit, sold for a slightly low price (compared to a moderate quality product), from which the majority of profits are distributed to a few leaders of the parent company. Some of this money is used to fund the astroturfing campaign. The product will probably brake in a year. Now, consider how much wasted energy is involved, how much waste it produces, and how it inflates our economy. It makes the average worker's money only appear to buy a "middle-class" lifestyle while allowing the executive class to pay its workers and contracted manufacturing less, and themselves more. They will be buying quality materials, for which the cost of production is higher because of decreased demand. Astroturfed, sham products experience increase of demand, because they need to be replaced, but they will never really improve because improvement requires more time and effort given to the production process, which leads to lower profits.

How long before this is the case for common needs? What are you eating? Is it Salisbury steak in a frozen container, or is it real steak? (But 623 reviewers said this is a healthy, nutritious product...) How soon will we be living in modular homes with walls made in China? (11,293 reviewers said this apartment complex is quaint, accommodating, and only one experienced a leaky roof...)

Re:Lets be realistic.... (1)

Animats (122034) | more than 2 years ago | (#36891290)

The people who produce false reviews will develop a tool that not only fakes the reviews, but then applies this exact software (in the article) to analyze it, and then provides logical adjustments until this exact software cannot discern the difference between the adjusted outcome or real reviews.

That's a very real problem. A few years ago, phishing sites could be distinguished from real sites by observing bad grammar, poor layout, and other indicators of low quality. Today, phishing sites look very much like real ones to humans.

For a few years, until 2008, there was the Web Spam Challenge [lip6.fr] . A large number of web pages had been classified by humans as "spam" or "not spam", and people ran classifiers against them to try to match the human judgement. That used to have some effectiveness, but the quality of junk web sites has improved, now that big companies like AOL and Demand Media generate them.

A superficial examination by humans isn't good enough any more. You need to dig deeper. For web spam, look at the business behind the web site. For recommendation spam, look at the person behind the recommendation. Social networks have enough information to do this for individuals. eBay and Amazon, which actually see the customer's transactions, can and do use that information.

How's it do on sarcastic reviews? (1)

djl4570 (801529) | more than 2 years ago | (#36890512)

Re:How's it do on sarcastic reviews? (1)

DaMattster (977781) | more than 2 years ago | (#36890660)

+1 - Especially because a sarcastic review is decidedly NOT positive. I guess it is wholly possible to modify the search criteria of Cornell's engine to look for review spam that trashes products. I am sure that practice is just as wide spread as overly positive reviews.

Re:How's it do on sarcastic reviews? (1)

xatm092 (1654477) | more than 2 years ago | (#36892556)

Interesting. They are not real reviews so technically they should come up as deceptive, which I guess they are.

Kind of Cool (1)

DaMattster (977781) | more than 2 years ago | (#36890646)

I like the idea very much. The article showed an example of two comments: one on the left and one on the right. This example is only easily spotted for folks familiar with SEO and web dev stuff. The review on the right hand side was clearly spam because the name of the product was used several times in the comment to pad a search engine. My guess is that, for a laymen, it isn't that obvious. Signs to look for are: (1) excessive use of capitol letters and punctuation marks, (2) excessive use of the product/service name, (3) Excessive grammar errors (can indicate a user paid to post but not necessarily so.), and (4) reviews that appear to be almost identical between products with simply the name switched out which could indicate a script doing the review.

Re:Kind of Cool (0)

Anonymous Coward | more than 2 years ago | (#36893124)

grammar errors are needed so that you don't find the same exact review posted to multiple sites.

Most product review shows on TV (1)

dutchwhizzman (817898) | more than 2 years ago | (#36891774)

Are fake as well. There are very few shows that don't get their products to review directly from the manufacturer. Most only get the products if they give a positive review. Did you ever watch a car show that didn't praise a car? How many shows actually compare products they bought in shops themselves and aren't afraid to fail the lot?

Re:Most product review shows on TV (0)

Anonymous Coward | more than 2 years ago | (#36892330)

Did you ever watch a car show that didn't praise a car?

Yes.

See: Top Gear, Fifth Gear

But how well does it work? (2)

boef (452862) | more than 2 years ago | (#36891788)

Apparently quite well – I’ve checked a few reviews on the product and all three people gave it 5 stars and called it AWESOME!!

Re:But how well does it work? (1)

KritonK (949258) | more than 2 years ago | (#36892568)

Yes, but did you run the software on its reviews, to test if they were fake?

Both are fake (0)

Anonymous Coward | more than 2 years ago | (#36891972)

How do they know the control group is authentic? There is nothing remotely specific in the left one. It says noob shill all over. Who would honestly submit a review like that and think it will be helpful to others?
Also funny how they call the fake ones "deceptive" and the ones supposedly written by customers "truthful". As if real customers wouldn't deceive or misperceive.

Leverage slashdot moderatation? (1)

benob (1390801) | more than 2 years ago | (#36892760)

Using the very same method, we could leverage moderation logs to predict which comments are informative, funny, deceptive...
Please admins, where's the API?

Load More Comments
Slashdot Account

Need an Account?

Forgot your password?

Don't worry, we never post anything without your permission.

Submission Text Formatting Tips

We support a small subset of HTML, namely these tags:

  • b
  • i
  • p
  • br
  • a
  • ol
  • ul
  • li
  • dl
  • dt
  • dd
  • em
  • strong
  • tt
  • blockquote
  • div
  • quote
  • ecode

"ecode" can be used for code snippets, for example:

<ecode>    while(1) { do_something(); } </ecode>
Sign up for Slashdot Newsletters
Create a Slashdot Account

Loading...