Beta

Slashdot: News for Nerds

×

Welcome to the Slashdot Beta site -- learn more here. Use the link in the footer or click here to return to the Classic version of Slashdot.

Thank you!

Before you choose to head back to the Classic look of the site, we'd appreciate it if you share your thoughts on the Beta; your feedback is what drives our ongoing development.

Beta is different and we value you taking the time to try it out. Please take a look at the changes we've made in Beta and  learn more about it. Thanks for reading, and for making the site better!

Facebook's Project Prism, Corona Could Ease Data Crunch

Soulskill posted about 2 years ago | from the would-take-an-awful-lot-of-corona dept.

Facebook 19

Nerval's Lobster writes "Facebook recently invited a handful of employers into its headquarters for a more in-depth look at how it handles its flood of data. Part of that involves the social network's upcoming 'Project Prism,' which will allow Facebook to maintain data in multiple data centers around the globe while allowing company engineers to maintain a holistic view of it, thanks to tools such as automatic replication. That added flexibility could help Facebook as it attempts to wrangle an ever-increasing amount of data. 'It allows us to physically separate this massive warehouse of data but still maintain a single logical view of all of it,' is how Wired quotes Jay Parikh, Facebook's vice president of engineering, as explaining the system to reports. 'We can move the warehouses around, depending on cost or performance or technology.' Facebook has another project, known as Corona, which makes its Apache Hadoop clusters less crash-prone while increasing the number of tasks that can be run on the infrastructure."

cancel ×

19 comments

Brilliant (3, Funny)

Sparticus789 (2625955) | about 2 years ago | (#41113033)

So glad to see FB coming up with an original idea like decentralized server infrastructure. Oh wait....

Re:Brilliant (1)

History's Coming To (1059484) | about 2 years ago | (#41116253)

I've suddenly just realised...the logical next-step is to offer a Diaspora* style self-hosted "app", crowdsource the cycles. Yes, the security may take a hit, but I'm sure it's nothing they can't cope with. Even if they can't, hey, it's just corrupted user data they're getting, and that doesn't seem to bother them with fake accounts.

The point is, think about the savings on server farms. If they save a chunk of money, the share price will shoot up, and that's what it's all about these days. You could end up with Facebook being an entirely user run program, all simply feeding back to central servers which just have to dump it to memory, no great CPU usage involved. A lot more money though.

Facebook status quo (0)

blackt0wer (2714221) | about 2 years ago | (#41113063)

So Facebook is finding ways to further mine user data? Given their poor stock performance, a shrinking legitimate user base, and a more savvy audience, I'm sure this is just a veiled attempt to sell your data to more people through "innovation".

Hmm... (4, Funny)

Antipater (2053064) | about 2 years ago | (#41113083)

I'm not sure I would want to trust my data with a system named for something prone to holes [wikipedia.org] and large mass ejections [wikipedia.org] .

Corona? (4, Funny)

Mister Transistor (259842) | about 2 years ago | (#41113085)

Doesn't the Facebook dept. of the NSA know that they already used the "operation" codeword Corona for the first spy satellites?

Re:Corona? (4, Funny)

VortexCortex (1117377) | about 2 years ago | (#41113529)

Doesn't the Facebook dept. of the NSA know that they already used the "operation" codeword Corona for the first spy satellites?

Yes, but they're working a different angle now: Carefree with a twist of lime.

Re:Corona? (1)

Hillgiant (916436) | about 2 years ago | (#41114813)

I agree, there are so many other Mexican beers they could have named the project after:
"I don't always randomly reduce user privacy protection. But when I do, I choose Dos Exes."

Brilliant... (1)

History's Coming To (1059484) | about 2 years ago | (#41113093)

Fantastic, that almost certainly means another change to the API/SDK processes. I can't wait for the number of grandparents joining to hit the critical mass where it all falls over and people leave for another network, ideally one with decent privacy and a decent API for public data.

Re:Brilliant... (4, Interesting)

VortexCortex (1117377) | about 2 years ago | (#41114077)

This will continue to happen over and over until we decide to fix the problem and make better software.

We wouldn't need Facebook if computers were easier to use. There's so many simple tasks like sharing large files, streaming voice and video, identity verification, decentralized public & private backup among your friends and family, messaging and status, etc. which are completely doable using our own home computers -- Not relying on any 3rd party besides the ISP.

Data silos are retarding progress. The human race is decentralized, focusing data or traffic in one direction is the same bad idea as giving supreme power to only a few. The problem is that our culture should belong to us, not some centralized advertising engine.

With mobile computing on the rise, I see a repeated sentiment that you don't need a home computer anymore.... Well, I disagree. I think we need them more than ever -- They can stream us all the data we have and help smooth out spotty mobile connection issues -- Post your status to your own machine, and have your friends machines aggregate push it out to them. There really is no distinction between client and server at the packet level. We trade convenience and ownership for security only because the awesome machines we use still (mostly) have some really shitty software on them.

I hold conversations with my close friends and family online with only our ISP aware of the packets between us, with data that I know is strongly encrypted. I see and comment on the photos my brother takes hundreds of miles away, as soon as he's plugged in his camera (I'm in his highest trust group for that camera, but not his phone or GF's web cam). I've restored my grandmother's data from our decentralized online backup without paying a red cent to a 3rd party (other than our ISPs). We don't need an (untrustworthy) 3rd party server to negotiate connections, we share connection graphs between peers, and our routers COOPERATE with our PCs!

I've been working on this cross platform technology for years in my spare time, it's a shame there's no money in making computing BETTER... I'm only one man -- imagine what one of those multi billion dollar "technology" corporations COULD do, if doing so were profitable. Hell, imagine if I could work on this little project full-time... Or even just imagine what would be possible if anyone else actually gave a damn about their data?

Re:Brilliant... (0)

Anonymous Coward | about 2 years ago | (#41120389)

Interesting! Have you written more about this elsewhere?

Re:Brilliant... (0)

Anonymous Coward | about 2 years ago | (#41127581)

Yes and communism would work if people weren't corrupt. People are corrupt, so it doesn't. We could use our own machines if software could be of a much higher standard, which it isn't.

Praise (1)

Anonymous Coward | about 2 years ago | (#41113123)

I have to give Facebook this: They're better at this sort of thing than anyone.

Just compare timeline to Slashdot comment history. Beyond the most recent comments, slashdot only allows you to search your history if you subscribe. Even then it's with a plea to please not do it too much...

Reddit is a more modern site I dare say, but they too don't let you go through your full comment history. After the first 1000, it gets really hard to trace them down.

Re:Praise (2)

Githaron (2462596) | about 2 years ago | (#41113545)

I actually hate timeline. I removes my ability to quickly scan through a news feed. Everything is ordered in multiple directions and forces you to scan in multiple directions. Left -> Right -> Left -> Down is a lot more complicated than just Down. It is the reason I never use Facebook from an actual computer anymore. I always use my phone or tablet.

not that good actually (0)

godrik (1287354) | about 2 years ago | (#41113141)

When I drink corona, I do not crunch data too well. Unless it involves a deck of cards!

Bring You Own Shard (4, Interesting)

scorp1us (235526) | about 2 years ago | (#41113315)

I don't know why we don't abstract all this cloud data storage to a truly vendor neutral, competitive scheme.

Imagine if we as users could provide our own server (at home, or designate Amazon, Google, etc) for our cloud storage. Facebook becomes just one application and anything we post is encoded in JSON formatted files. Then we actually own what we post. Of course, Facebook can cache the data (since first post generally is the most needed) and only go back to your cloud for older data. But you'd have every wall post, every photo, all of your data shared. Then Facebook can give you 1gig free, but you can also buy 5gig from google and have them use that instead. It gives them infinite storage, they only need to manage their cache.

Re:Bring You Own Shard (0)

Anonymous Coward | about 2 years ago | (#41115297)

That would be awesome for users, yes. However, preventing you from moving your data and social graph elsewhere is the only thing that makes Facebook valuable. That's why they don't let you do that and they never will until they start losing a lot of traffic because people demand to control their own data - that isn't going to happen any time soon.

Re:Bring You Own Shard (1)

History's Coming To (1059484) | about 2 years ago | (#41121915)

Simple solution - download all of your data (Facebook's graph API uses JSON) then delete your account. Then simply set up your own system allowing people to see your photos, leave comments etc. We used to call them "personal websites" back in the day, but if it's going to catch on these days we better start calling them "synergistic personal cloud sharing social micronets".

huh (2)

koan (80826) | about 2 years ago | (#41114101)

""Facebook recently invited a handful of employers into its headquarters "

Which employers? Why? Is facebook going to start providing companies with the data of job applicants?

Speaking of Prism... (-1)

Anonymous Coward | about 2 years ago | (#41114483)

Remember the Mozilla Prism project that let you put a website in its own application?
Today Mozilla is testing the new integrated webapps on android [wordpress.com] , hop in and play with them :)
You can also test them on Nightly builds [mozilla.org] of desktop Firefox by going to a test marketplace [bit.ly]

Check for New Comments
Slashdot Account

Need an Account?

Forgot your password?

Don't worry, we never post anything without your permission.

Submission Text Formatting Tips

We support a small subset of HTML, namely these tags:

  • b
  • i
  • p
  • br
  • a
  • ol
  • ul
  • li
  • dl
  • dt
  • dd
  • em
  • strong
  • tt
  • blockquote
  • div
  • quote
  • ecode

"ecode" can be used for code snippets, for example:

<ecode>    while(1) { do_something(); } </ecode>
Create a Slashdot Account

Loading...