PDA

View Full Version : The day has finally come.



michapma
03-24-2004, 07:17 AM
Hello everybody,

Some of you may or may not have noticed that OberstWiley's website has been down recently. There is of course a good reason for this, so here is an explanation of what the problem is, what's being done about it, and what ramifications it might have in the longer run. This is the website in quesiton:

http://people.ee.ethz.ch/~chapman/flightsims/oberstguncam/Frameset/

Sometime about two years back I rather admired Wiley's creative guncam clip GIFs, noticed he was having lots of frustration with his host, and offered to host his website. I happen to have an account with lots of space on my server, and the server is top notch with incredible bandwidth, and maintained by very competent folks. It's worked really well for a long time, although I always told Wiley that I can't guarantee hosting forever. As you probably know, in the last two years something of an IL-2/FB film culture has developed, and Wiley has orchestrated a lot of the popular FB movies to be made available on his website. Well, the day has finally come when the size and quantity of requests has gotten to be a problem, and the system administrator has come to me to discuss.

The problem is not with the storage of the 3+ gigabytes of films, and it's not with the bandwidth being used. The problem is with the occasional intensity of requests that are made. Probably when people come to visit the site and download a film, they see other films and start a lot of downloads. The downloads of these huge data files can take a while, and the process that manages the connection (each time someone clicks) takes a long time and stays open on the server quite a while. What's worse, sometimes the connection gets lost somewhere between client and server, but the process stays open on the server without transferring any data. (Probably the person clicks again in this case and opens a new process.) From the server standpoint it can technically look similar to a denial of service attack, although it really is not. The result is that during a period of intense downloading from the website, all the processes connected with the downloads can literally block the server, due in large part to this external access to my private webspace.

The server that I've been using belongs to the electrical engineering department of the Swiss Federal Institute of Technology. The system administrators are really great guys. They have recognized that a problem has developed for the past few weeks (it hasn't always been a problem), and have been trying to alleviate the problem through better configuration of the server! Amazing, considering they knew that it was due to private use of the resources. Finally they've come and said something has to give. The server was really very slow this morning, I noticed it myself when I tried to access my site that it took about 10 or more seconds to respond. They blocked off the access rights to the folder containing the website, and came to talk with me.

All of the movie files (large and small) have been moved off the webspace so that the website can come back online, so normal access to Wiley's site has been restored. However, you won't find any films there for the time being, until a solution is arrived at to manage the requests.

What is needed is a separate machine on which a dedicated Apache server can be run to handle the requests. As it turns out, we have an older machine that is capable of doing just that. I've asked those in my department who use the machine, and the server should be able to be configured in a way that it doesn't eat all the machine's resources during a period of intense activity. If that is successful, then the films will be made available again, although I might just take a few of them offline anyway. I mean, 3GB is 3GB.

Bottom line, no movies for a short while from my server. The rest of the website is up, and all of the smaller, non-movie files are accessible. When a solution is found, probably next week or the week after, most of the movies should become available again and I can continue hosting them. The whole site might get moved to a new web address, so everyone would have to update their bookmarks.

Thanks for understanding and hope to continue serving you soon. http://ubbxforums.ubi.com/images/smiley/16x16_smiley-wink.gif
Mike

http://www.baseclass.modulweb.dk/69giap/fileadmin/Image_Archive/badges/69giap_badge_chap.jpg (http://giap.webhop.info)

The ongoing IL-2 User's Guide (http://people.ee.ethz.ch/~chapman/il2guide/) | Forgotten Skies (http://www.forgottenskies.com/)
But we are all that way: when we know a thing we have only scorn for other people who don't happen to know it. - Mark Twain, Personal Recollections of Joan of Arc

michapma
03-24-2004, 07:17 AM
Hello everybody,

Some of you may or may not have noticed that OberstWiley's website has been down recently. There is of course a good reason for this, so here is an explanation of what the problem is, what's being done about it, and what ramifications it might have in the longer run. This is the website in quesiton:

http://people.ee.ethz.ch/~chapman/flightsims/oberstguncam/Frameset/

Sometime about two years back I rather admired Wiley's creative guncam clip GIFs, noticed he was having lots of frustration with his host, and offered to host his website. I happen to have an account with lots of space on my server, and the server is top notch with incredible bandwidth, and maintained by very competent folks. It's worked really well for a long time, although I always told Wiley that I can't guarantee hosting forever. As you probably know, in the last two years something of an IL-2/FB film culture has developed, and Wiley has orchestrated a lot of the popular FB movies to be made available on his website. Well, the day has finally come when the size and quantity of requests has gotten to be a problem, and the system administrator has come to me to discuss.

The problem is not with the storage of the 3+ gigabytes of films, and it's not with the bandwidth being used. The problem is with the occasional intensity of requests that are made. Probably when people come to visit the site and download a film, they see other films and start a lot of downloads. The downloads of these huge data files can take a while, and the process that manages the connection (each time someone clicks) takes a long time and stays open on the server quite a while. What's worse, sometimes the connection gets lost somewhere between client and server, but the process stays open on the server without transferring any data. (Probably the person clicks again in this case and opens a new process.) From the server standpoint it can technically look similar to a denial of service attack, although it really is not. The result is that during a period of intense downloading from the website, all the processes connected with the downloads can literally block the server, due in large part to this external access to my private webspace.

The server that I've been using belongs to the electrical engineering department of the Swiss Federal Institute of Technology. The system administrators are really great guys. They have recognized that a problem has developed for the past few weeks (it hasn't always been a problem), and have been trying to alleviate the problem through better configuration of the server! Amazing, considering they knew that it was due to private use of the resources. Finally they've come and said something has to give. The server was really very slow this morning, I noticed it myself when I tried to access my site that it took about 10 or more seconds to respond. They blocked off the access rights to the folder containing the website, and came to talk with me.

All of the movie files (large and small) have been moved off the webspace so that the website can come back online, so normal access to Wiley's site has been restored. However, you won't find any films there for the time being, until a solution is arrived at to manage the requests.

What is needed is a separate machine on which a dedicated Apache server can be run to handle the requests. As it turns out, we have an older machine that is capable of doing just that. I've asked those in my department who use the machine, and the server should be able to be configured in a way that it doesn't eat all the machine's resources during a period of intense activity. If that is successful, then the films will be made available again, although I might just take a few of them offline anyway. I mean, 3GB is 3GB.

Bottom line, no movies for a short while from my server. The rest of the website is up, and all of the smaller, non-movie files are accessible. When a solution is found, probably next week or the week after, most of the movies should become available again and I can continue hosting them. The whole site might get moved to a new web address, so everyone would have to update their bookmarks.

Thanks for understanding and hope to continue serving you soon. http://ubbxforums.ubi.com/images/smiley/16x16_smiley-wink.gif
Mike

http://www.baseclass.modulweb.dk/69giap/fileadmin/Image_Archive/badges/69giap_badge_chap.jpg (http://giap.webhop.info)

The ongoing IL-2 User's Guide (http://people.ee.ethz.ch/~chapman/il2guide/) | Forgotten Skies (http://www.forgottenskies.com/)
But we are all that way: when we know a thing we have only scorn for other people who don't happen to know it. - Mark Twain, Personal Recollections of Joan of Arc

lil_labbit
03-24-2004, 07:29 AM
Sad to hear this....

But thanks for hosting all this time http://ubbxforums.ubi.com/infopop/emoticons/icon_biggrin.gif

I realy love what Wiley's done in the past, I hope he's up soon again...

http://members.home.nl/lil.labbit/lilseesya.jpg
Night is better than Day

Tully__
03-24-2004, 07:45 AM
michapma, I hope you have some appreciation of how much your generosity enriches this community!! Thank you so much http://ubbxforums.ubi.com/infopop/emoticons/icon_smile.gif.

=================================================


http://members.optusnet.com.au/tully_78th/Corsair.jpg (http://www.mudmovers.com/sturmovik_101/FAQ.htm)

IL2 Forums Moderator
Forum Terms of Use (http://www.ubi.com/US/Info/TermsOfUse.htm)

Salut
Tully

HH Quazi
03-24-2004, 08:06 AM
Thank you Michapma for your generosity. And please pass a word of thanks for those working with you to come up with a solution. S!

http://www.angelfire.com/falcon/nightschpanker/QuasiPOWsmall.jpg

widgeon
03-24-2004, 09:59 AM
Yes, thankyou.


Widgeon

Dunkelgrun
03-24-2004, 10:28 AM
Top man, Mike. Thanks for all you do.
Cheers!

http://www.uploadit.org/igmusapa/tft2.jpg
www.nightbomber.com (http://www.nightbomber.com)

Dunkelgrun aka 242Sqn_Cat

Old_Canuck
03-24-2004, 10:40 AM
<BLOCKQUOTE class="ip-ubbcode-quote"><font size="-1">quote:</font><HR>Originally posted by Dunkelgrun:
Top man, Mike. Thanks for all you do.
Cheers!

....<HR></BLOCKQUOTE>

http://ubbxforums.ubi.com/images/smiley/11.gif I can agree to that. You're a good example to the rest of us, Mike. Thanks for all your contributions to this great community.

If you need any new parts for that old machine, send me a PT and I'll have a look in my piggy bank http://ubbxforums.ubi.com/images/smiley/16x16_smiley-wink.gif

OC

"You don't stop playing because you grow old, you grow old because you stop playing."

T_O_A_D
03-24-2004, 11:09 AM
http://ubbxforums.ubi.com/images/smiley/52.gif I hope it get rectified! I can't agree more with the other posters here with how they and I feel about the contribution thats being made. http://ubbxforums.ubi.com/images/smiley/11.gif

Have you checked your Private Topics recently? (http://forums.ubi.com/eve/forums?a=ugtpc&s=400102)
131st_Toad's Squad link (http://www.geocities.com/vfw_131st/)
My TrackIR fix, Read the whole thread (http://forums.ubi.com/eve/forums?q=Y&a=tpc&s=400102&f=49310655&m=15310285&p=1)
2.11 drivers (http://home.mchsi.com/~131st-vfw/NaturalPoint_trackIR_2_11.exe)
http://home.mchsi.com/~131st_vfw/T_O_A_D.jpg

ShadowSix
03-24-2004, 02:58 PM
Michapma, I know I'm speaking for the entire community when I say "thanks" for giving us the opportunity to host our movies on your server. Wiley and you are real great guys and we truly appreciate what you have done for the virtual film community.

Again, thanks for your generosity.

--ShadowSix

michapma
03-25-2004, 03:50 AM
Thanks for the nice thoughts, everybody. However, what I do might not quite be worth a http://ubbxforums.ubi.com/images/smiley/11.gif because all I do is use a T1 connection to download movies and then save them to a folder, and update Wiley's site with the new files he sends. http://ubbxforums.ubi.com/images/smiley/16x16_smiley-wink.gif

The real http://ubbxforums.ubi.com/images/smiley/11.gif belongs to the institute running the server. I'm relieved that they not only aren't upset about the use of resources, because I was totally open with them about what was going on, but that they also are willing to make a solution. http://ubbxforums.ubi.com/images/smiley/16x16_smiley-surprised.gif http://ubbxforums.ubi.com/images/smiley/16x16_smiley-happy.gif http://ubbxforums.ubi.com/images/smiley/16x16_smiley-happy.gif

I think they got a good idea how much this community appreciates the service from the fact that the requests flattened their main server. http://ubbxforums.ubi.com/images/smiley/16x16_smiley-very-happy.gif And I plan to find at least some small way of thanking them. Canuck, the machine is not the problem, the whole concern was how to make it work without it being a lot of extra work or imposition on anybody.

Thanks everyone for understanding. Please do spread the word that the movies should come be back online before long if you see people asking. Wiley has provided updates for the site to explain the problem, I'm going to go update it now.

Cheers!

http://www.baseclass.modulweb.dk/69giap/fileadmin/Image_Archive/badges/69giap_badge_chap.jpg (http://giap.webhop.info)

The ongoing IL-2 User's Guide (http://people.ee.ethz.ch/~chapman/il2guide/) | Forgotten Skies (http://www.forgottenskies.com/)
But we are all that way: when we know a thing we have only scorn for other people who don't happen to know it. - Mark Twain, Personal Recollections of Joan of Arc