PDA

View Full Version : Testing protocol needed



BaldieJr
05-20-2004, 01:40 PM
I need help figuring out how to write a plane-testing bot using the new functions in the game.

Since you can't pull guage data from the sim while in multiplayer mode, anyone wanting to test a specific plane will have to create a mission to do it in.

So...

My questions are:
What map/ airfield should be used to test all flyable planes?
What starting conditions should the plane be in?
(on the ground with engine off or air start?)
And finally, the biggest question of all:
What should be tested?

Thanks for any input.

<pre class="ip-ubbcode-code-pre">
My Specs (read 'em and weep):
* Automatically grinds whole beans before brewing
* Fully programmable 24 hours in advance
* Brew Pause feature lets you enjoy a cup before brewing has finished
* Automatically shuts off when brewing is complete
* Grind-off feature for brewing ground coffee
* 1-4 cup feature to accommodate coffee for one
* 10-cup double-wall insulated thermal carafe to keep your coffee hot long after brewing
* Gold tone commercial-style permanent filter eliminates the need to buy coffee filters
* Charcoal water filter removes impurities from the water
* Separate grinder chamber and filter area allow for easy cleanup
* Limited 3-year warranty
</pre>

BaldieJr
05-20-2004, 01:40 PM
I need help figuring out how to write a plane-testing bot using the new functions in the game.

Since you can't pull guage data from the sim while in multiplayer mode, anyone wanting to test a specific plane will have to create a mission to do it in.

So...

My questions are:
What map/ airfield should be used to test all flyable planes?
What starting conditions should the plane be in?
(on the ground with engine off or air start?)
And finally, the biggest question of all:
What should be tested?

Thanks for any input.

<pre class="ip-ubbcode-code-pre">
My Specs (read 'em and weep):
* Automatically grinds whole beans before brewing
* Fully programmable 24 hours in advance
* Brew Pause feature lets you enjoy a cup before brewing has finished
* Automatically shuts off when brewing is complete
* Grind-off feature for brewing ground coffee
* 1-4 cup feature to accommodate coffee for one
* 10-cup double-wall insulated thermal carafe to keep your coffee hot long after brewing
* Gold tone commercial-style permanent filter eliminates the need to buy coffee filters
* Charcoal water filter removes impurities from the water
* Separate grinder chamber and filter area allow for easy cleanup
* Limited 3-year warranty
</pre>

BaldieJr
05-20-2004, 07:23 PM
Clearly no interest.

I'll hack on something else then.

<pre class="ip-ubbcode-code-pre">
My Specs (read 'em and weep):
* Automatically grinds whole beans before brewing
* Fully programmable 24 hours in advance
* Brew Pause feature lets you enjoy a cup before brewing has finished
* Automatically shuts off when brewing is complete
* Grind-off feature for brewing ground coffee
* 1-4 cup feature to accommodate coffee for one
* 10-cup double-wall insulated thermal carafe to keep your coffee hot long after brewing
* Gold tone commercial-style permanent filter eliminates the need to buy coffee filters
* Charcoal water filter removes impurities from the water
* Separate grinder chamber and filter area allow for easy cleanup
* Limited 3-year warranty
</pre>

tttiger
05-20-2004, 07:39 PM
Baldie, this is exactly my problem with all the Virtual Test Pilots out there.

There is no established protocol, so we're often comparing apples and oranges, no matter how good the intentions of the people doing the testing may be.

When people start putting charts and graphs up from their testing, frankly, I don't give them any credibility. Some have full tank of fuel while others have less, none use the same benchmark aircraft, some are at sea level some are at 5,000 meters. Some are even at 10,000 meters when we know everything above 7,000 meters is totally screwed up in FB, so what's the point?

I'm not knocking the testers. If they get their jollies by testing rather than fighting, that's fine with me. But their data all is highly suspect.

Perhaps they need a forum of their own so they can work out testing protocols that they all will use.

Until then, I think what they are doing and what they are presenting as "data" is meaningless.

When I flew WarBirds, we had one guy, Grant Iddons, who did all the testing. He always used exactly the same methods and presented hgis findings in nice, clear tables on his web site.

Here's the formats he used, maybe it's a place to start:

http://www.geocities.com/Heartland/6302/Perform/flight_test_department.htm

That's the way it should be done but here, every test pilot tests a different way.

ttt

"I want the one that kills the best with the least amount of risk to me"

-- Chuck Yeager describing "The Best Airplane."

TheGozr
05-20-2004, 07:40 PM
more details?

"Pilote d'essais" "test pilot"

I remember i had a special message from Oleg himself telling me how he liked the France vs Germany fight and the idea .

"-PROWAR"
I'm waiting for the Server release to be able to start again.
-GOZR
http://www.french.themotorhead.com/forgotten-battles/images/IOCompetition.jpg &lt;--Competition Level IL2fb here (http://www.french.themotorhead.com/forgotten-battles/)

[This message was edited by TheGozr on Thu May 20 2004 at 06:59 PM.]

LEXX_Luthor
05-20-2004, 07:46 PM
Oleg says use Crimea map.

robban75 is the only one here who tries to do serious FM testing. I do some, here and there. My conflicting data from my Ki~84 tests was a total embarassment.



__________________
http://ubbxforums.ubi.com/images/smiley/10.gif Flyable Swedish "Gladiator" listed as J8A ...in Aces Expansion Pack


"You will still have FB , you will lose nothing" ~WUAF_Badsight
"I had actually pre ordered CFS3 and I couldnt wait..." ~Bearcat99
"Gladiator and Falco, elegant weapons of a more civilized age" ~ElAurens
:
"Damn.....Where you did read about Spitfire made from a wood?
Close this book forever and don't open anymore!" ~Oleg_Maddox http://ubbxforums.ubi.com/images/smiley/16x16_smiley-surprised.gif

p1ngu666
05-20-2004, 07:56 PM
crimea and fly off edge or along edge of map
also u could poke il2compair first

http://www.pingu666.modded.me.uk/mysig3.jpg
&lt;123_GWood_JG123&gt; NO SPAM!

p1ngu666
05-20-2004, 07:58 PM
i dont expect u to stay in a ki84 long luther, being uber and all
but i saw u request skins for a 262 on il2skins
http://ubbxforums.ubi.com/images/smiley/10.gifmaybe luther has a secret uber plane fetish http://ubbxforums.ubi.com/images/smiley/16x16_smiley-surprised.gif

http://www.pingu666.modded.me.uk/mysig3.jpg
&lt;123_GWood_JG123&gt; NO SPAM!

nickdanger3
05-20-2004, 08:11 PM
Baldie - since you dibbs-ed it, why not just let the rest know how you think is best and go for it.

BaldieJr
05-20-2004, 09:27 PM
<BLOCKQUOTE class="ip-ubbcode-quote"><font size="-1">quote:</font><HR>Originally posted by nickdanger3:
Baldie - since you dibbs-ed it, why not just let the rest know how you think is best and go for it.<HR></BLOCKQUOTE>

Because writing a bot that will take a plane through its paces is not going to be easy (at least for someone with 1 major project to fiddle with and a job). I don't want to write the thing because then everyone will say "how come it doesn't do X?" and "Y is a stupid test!" or "You shot me down on HL last night and I know you programed that bot you cheater!!!1".

After I thought about it, I realized that a perfect test environment would probably just piss a lot of people off.

<pre class="ip-ubbcode-code-pre">
My Specs (read 'em and weep):
* Automatically grinds whole beans before brewing
* Fully programmable 24 hours in advance
* Brew Pause feature lets you enjoy a cup before brewing has finished
* Automatically shuts off when brewing is complete
* Grind-off feature for brewing ground coffee
* 1-4 cup feature to accommodate coffee for one
* 10-cup double-wall insulated thermal carafe to keep your coffee hot long after brewing
* Gold tone commercial-style permanent filter eliminates the need to buy coffee filters
* Charcoal water filter removes impurities from the water
* Separate grinder chamber and filter area allow for easy cleanup
* Limited 3-year warranty
</pre>

lil_labbit
05-20-2004, 11:09 PM
Interest enough - but how-to ? hmmm we gotta think about thatta one - and thinking takes time...
http://ubbxforums.ubi.com/infopop/emoticons/icon_wink.gif

http://members.home.nl/lil.labbit/lilseesya.jpg
Night is better than Day

Eagle_361st
05-20-2004, 11:28 PM
The most common testing factors are usually:
1) Crimea map
2) Sea Level
3) 5000 Meters
4) 100% fuel
5) 25% fuel
6) Default ammo
7) Empty ammo
Hope that helps

~S!
Eagle
Commanding Officer 361st vFG
www.361stvfg.com (http://www.361stvfg.com)
http://home.comcast.net/~smconlon/wsb/media/245357/site1079.jpg

Friendly_flyer
05-21-2004, 12:14 AM
Why the Crimean map? Wouldn't one of the smaller maps make things easyer?

Making the "perfegct" test mission is not possible. Different folks want to test different things. A test mission/environment can not be rigged to test all things equally well. That does not mean you should not try to make a stadarized test Baldie, just that you should clearly state what it is for testing.

An idea might be to make a mission/enviornment that might be modefied for various tests.

Fly friendly!

Petter Bøckman
Norway

PikeBishop
05-21-2004, 07:30 AM
Hi folks,

I must say that this THE all important issue.
A standard protocol with a set of rigid operating procedures will tell one everything they need to know about the performance of a given type, simply because all the data will be valid comparatively speaking.
My only reservation is that in my opinion people really need to be "trained" to carry out these types of tests.
Consistency is all important as data reproduction is the proof of the pudding, but I think it is VERY hard to achieve.
best regards,

SLP.

WOLFMondo
05-21-2004, 07:34 AM
Some one needs to write a test plan and test specification...I do this at work every day so count me outhttp://ubbxforums.ubi.com/infopop/emoticons/icon_razz.gif

http://bill.nickdafish.com/sig/mondo.jpg
Wolfgaming.net. Where the Gameplay is teamplay (http://www.wolfgaming.net)

p1ngu666
05-21-2004, 01:00 PM
bump

http://www.pingu666.modded.me.uk/mysig3.jpg
&lt;123_GWood_JG123&gt; NO SPAM!