If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. |
|
|
Thread Tools | Display Modes |
#1
|
|||
|
|||
interesting problem and help me out
Hi This is the problem I'm trying to find a good solution
I have a big file in the server and I want to copy it to the 10000( say large number of) clients. I don't want the server to send the data individually to each and every client as it overloads the server. Instead I want to use peer to peer kind of data transfer say every machine is capable of sending and receiving data. Meanwhile that big file is cut into small small chunks to do the transfer via many threads across many peers. This is all I could think about the problem.. I'm sure the solution is not as easy as this and there would be lots issues in it.. Can anybody kindly tell me various other issues that are to be considered and I would be grateful if you suggest me one another solution.. Thankyou |
#2
|
|||
|
|||
interesting problem and help me out
Hate to burst your bubble but unless your network is *HARD WIRED* for peer
to peer, your server is going to be doing all/most of the transfers anyway... As for how to break something into small pieces... a number of ways... multi-part zips, email, local torrent, stuff like that... -- MEB http://peoplescounsel.org a Peoples' counsel _ _ ~~ "harry" wrote in message ... | Hi This is the problem I'm trying to find a good solution | I have a big file in the server and I want to copy it to the | 10000( say large number of) clients. I don't want the server to send | the data individually to each and every client as it overloads the | server. Instead I want to use peer to peer kind of data transfer say | every machine is capable of sending and receiving data. Meanwhile that | big file is cut into small small chunks to do the transfer via many | threads across many peers. | This is all I could think about the problem.. I'm sure the solution is | not as easy as this and there would be lots issues in it.. | Can anybody kindly tell me various other issues that are to be | considered and I would be grateful if you suggest me one another | solution.. | Thankyou |
#3
|
|||
|
|||
interesting problem and help me out
Hate to burst your bubble but unless your network is *HARD WIRED* for peer
to peer, your server is going to be doing all/most of the transfers anyway... As for how to break something into small pieces... a number of ways... multi-part zips, email, local torrent, stuff like that... -- MEB http://peoplescounsel.org a Peoples' counsel _ _ ~~ "harry" wrote in message ... | Hi This is the problem I'm trying to find a good solution | I have a big file in the server and I want to copy it to the | 10000( say large number of) clients. I don't want the server to send | the data individually to each and every client as it overloads the | server. Instead I want to use peer to peer kind of data transfer say | every machine is capable of sending and receiving data. Meanwhile that | big file is cut into small small chunks to do the transfer via many | threads across many peers. | This is all I could think about the problem.. I'm sure the solution is | not as easy as this and there would be lots issues in it.. | Can anybody kindly tell me various other issues that are to be | considered and I would be grateful if you suggest me one another | solution.. | Thankyou |
#4
|
|||
|
|||
interesting problem and help me out
I have a big file in the server and I want to copy it to the 10000( say large number of) clients. I don't want the server to send the data individually to each and every client as it overloads the server. Instead I want to use peer to peer kind of data transfer say every machine is capable of sending and receiving data. Meanwhile that big file is cut into small small chunks to do the transfer via many threads across many peers. sounds like you want a small bittorrent network running there at your company :-) read more about bit torrent on http://en.wikipedia.org/wiki/Bittorrent and yes, it is a perfect way to transfere big files from one source to many computers. but you need a tracker server on one computer that the other computers can ask on wich computers the file parts are on. since your file probably isn't public data you can't just use http://thepiratebay.org/ though... perhaps there are specialized applications that let you automaticly distibute the files between all the computers until all have it, managing so all computers not try to start download exactly the same time etc... good luck, an tell us what you found! |
#5
|
|||
|
|||
interesting problem and help me out
I have a big file in the server and I want to copy it to the 10000( say large number of) clients. I don't want the server to send the data individually to each and every client as it overloads the server. Instead I want to use peer to peer kind of data transfer say every machine is capable of sending and receiving data. Meanwhile that big file is cut into small small chunks to do the transfer via many threads across many peers. sounds like you want a small bittorrent network running there at your company :-) read more about bit torrent on http://en.wikipedia.org/wiki/Bittorrent and yes, it is a perfect way to transfere big files from one source to many computers. but you need a tracker server on one computer that the other computers can ask on wich computers the file parts are on. since your file probably isn't public data you can't just use http://thepiratebay.org/ though... perhaps there are specialized applications that let you automaticly distibute the files between all the computers until all have it, managing so all computers not try to start download exactly the same time etc... good luck, an tell us what you found! |
Thread Tools | |
Display Modes | |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
OT, hopefully interesting | Roger Fink | General | 0 | November 22nd 07 07:15 AM |
This is interesting... | MajBach1 | Software & Applications | 8 | February 3rd 05 04:13 AM |
Interesting problem | Russell Versteeg | Networking | 6 | October 28th 04 04:55 PM |
Interesting problem for experts | DMI | Networking | 3 | October 16th 04 08:59 PM |
Help with an interesting problem | Nick | General | 2 | June 8th 04 01:18 PM |