Thread Links Date Links
Thread Prev Thread Next Thread Index Date Prev Date Next Date Index

Few ideas for evaluation criteria guidelines document



In order to facilitate tomorrow's discussion, here are few ideas for
what to include in the evaluation criteria document.

1) checklist - proposed in 21-04-0152-03
a (detailed) map to the requirements document in order to catalog and
classify proposals and facilitate harmonization.

2) quantitative / qualitative performance  measures - proposed in
21-04-0152-03
includes metrics that can be used to compare proposals in simulation,
analysis, or prototype implementation experiments:
overhead, delay, packet loss, complexity, deployment requirement,
interoperability

3) reference model/ architecture - proposed in 21-04-0152-03 & used in
21-04-0162
defines the handover optimizations in the context of known IP mobility
schemes:
Mobile IPv4, Mobile IPv6, FMIP, HMIP, SIP, others?

4) trigger events sequence diagram/flow chart - some example is given in
21-04-0162
could be constructed from proposed trigger events based on agreed upon
handover scenarios and options: Examples found  in 21-04-0162 include:
- 802 to 3 GPPP: a) MS initiated/MS controlled, b) MS initiated/Network
controlled, c)Network initiated and controlled.
 3GPPP to 802: a) MS initiated
- inter/intra 802
- others?

5) usage models/scenarios
these are used in most protocol performance analysis studies,
comparative and evaluation criteria documents and they typically include
some detailed descriptions in order for simulation and/or analytical
results to be compared and replicated. For example:
- application (traffic characterization): voice, video, file transfer, etc.
- network topology/configuration: user equipement (interface, power tx),
access network (number, type, distance, coverage area)
- mobility model: description of user path between from one access
network to the other.
-  meta usage models that define parameters for the above elements: eg.
residential, office, airport, train., etc.


-nada

--
Nada Golmie, Ph.D.
Manager, High Speed Network Technologies Group
National Institute of Standards and Technology
100 Bureau Dr. Stop 8920
Gaithersburg, MD 20899
Email: nada@nist.gov
Phone: (301) 975-4190
Fax:   (301) 590-0932
Web: http://w3.antd.nist.gov