Computer simulation has been used extensively as an effective tool in the design and evaluation of systems. One should not, however, underestimate the importance of validation—the process of ensuring whether a simulation model is an appropriate representation of the real-world system. Validation of wireless network simulations is difficult due to strong interdependencies among protocols at different layers and uncertainty in the wireless environment. The authors present an approach of coupling direct-execution simulation and traces from real outdoor experiments to validating simple wireless models that are used commonly in simulations of wireless ad hoc networks. This article documents a common testbed that supports direct execution of a set of ad hoc routing protocol implementations in a wireless network simulator. By comparing routing behavior measured in the real experiment with behavior computed by the simulation, the authors validate the models of radio behavior upon which protocol behavior depends.
Law, A. M. , and W. D. Kelton . 2000. Simulation modeling and analysis. 3rd ed.New York: McGraw-Hill .
2.
Heidemann, J. , N. Bulusu , J. Elson , C. Intanagonwiwat , K. Lan , Y. Xu , W. Ye , D. Estrin , and R. Govindan . 2001. Effects of details in wireless network simulation . In Proceedings of the SCS Multiconference on Distributed Simulation, January, pp. 3-11 .
3.
Takai, M. , R. Bagrodia , K. Tang , and M. Gerla . 2001. Efficient wireless network simulations with detailed propagation models . Wireless Networks7 (3): 297-305 .
4.
Takai, M. , J. Martin , and R. Bagrodia . 2001. Effects of wireless physical layer modeling in mobile ad hoc networks . In Proceedings of the 2nd ACM International Symposium on Mobile Ad Hoc Networking & Computing (MobiHoc’01), October, pp. 87-94 .
5.
Kotz, D. , C. Newport , R. Gray , J. Liu , Y. Yuan , and C. Elliott . 2004. Experimental evaluation of wireless simulation assumptions . In Proceedings of the 7th ACM/IEEE International Symposium on Modeling, Analysis and Simulation of Wireless and Mobile Systems (MSWiM’04), October, pp. 78-82 .
6.
Bajaj, L. , M. Takai , R. Ahuja , K. Tang , R. Bagrodia , and M. Gerla . 1999. GloMoSim: A scalable network simulation environment. Tech. Rep. 990027, Department of Computer Science, University of California at Los Angeles .
7.
Karp, B. , and H. T. Kung . 1998. Dynamic neighbor discovery and loopfree, multi-hop routing for wireless, mobile networks. Unpublished manuscript, Harvard University, Cambridge, MA .
8.
Perkins, C. E. , and E. M. Royer . 1999. Ad hoc on-demand distance vector routing . In Proceedings of the 2nd IEEE Workshop on Mobile Computing Systems and Applications, February, pp. 90-100 .
9.
Karp, B. , and H. T. Kung . 2000. Greedy perimeter stateless routing for wireless networks . In Proceedings of the Sixth Annual ACM/IEEE International Conference on Mobile Computing and Networking (Mobi-Com’00), August, pp. 243-254 .
10.
Lee, S. J. , M. Gerla , and C. C. Chiang . 2002. On-demand multicast routing protocol in multihop wireless mobile networks . Mobile Networks and Applications7 (6): 441-453 .
11.
Gupta, P. , and P. R. Kumar . 1997. A system and traffic dependent adaptive routing algorithm for ad hoc networks . In Proceedings of the 36th IEEE Conference on Decision and Control, December, pp. 2375-2380 .
12.
Gray, R. S. , D. Kotz , C. Newport , N. Dubrovsky , A. Fiske , J. Liu , C. Masone , S. McGrath , and Y. Yuan . 2004. Outdoor experimental comparison of four ad hoc routing algorithms . In Proceedings of the 7th ACM/IEEE International Symposium on Modeling, Analysis and Simulation of Wireless and Mobile Systems (MSWiM’04), October, pp. 220-229 .
13.
Liu, J. , and D. M. Nicol . 2002. Lookahead revisited in wireless network simulations . In Proceedings of the 16th Workshop on Parallel and Distributed Simulation (PADS’02), May, pp. 79-88 .
14.
Rappaport, T. S.1996. Wireless communications: Principles and practice. Englewood Cliffs, NJ: Prentice Hall .
15.
Gray, R. S. 2000. Soldiers, agents and wireless networks: A report on a military application . In Proceedings of the 5th International Conference and Exhibition on the Practical Application of Intelligent Agents and Multi-Agents, April.
16.
Gupta, P. 2000. Design and performance analysis of wireless networks. Ph.D. diss., University of Illinois at Urbana-Champaign.
17.
Liu, J. , L. F. Perrone , D. M. Nicol , M. Liljenstam , C. Elliott , and D. Pearson . 2001. Simulation modeling of large-scale ad-hoc sensor networks . In Proceedings of the European Simulation Interoperability Workshop (Euro-SIW’01), June.
18.
Neufeld, M. , A. Jain , and D. Grunwald . 2002. Nsclick: Bridging network simulation and deployment . In Proceedings of the 5th ACM International Workshop on Modeling Analysis and Simulation of Wireless and Mobile Systems (MSWiM’02), September, pp. 74-81 .
19.
Dimitropoulos, X. A. , and G. F. Riley . 2003. Creating realistic BGP models . In Proceedings of the 11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer Telecommunications Systems (MASCOTS’03), October, pp. 64-70 .
20.
Dwarkadas, S. , J. R. Jump , and J. B. Sinclair . 1994. Execution-driven simulation of multiprocessors . ACM Transactions on Modeling and Computer Simulation4 (4): 314-338 .
21.
Reinhardt, S. K. , M. D. Hill , J. R. Larus , A. R. Lebeck , J. C. Lewis , and D. A. Wood . 1993. The Wisconsin Wind Tunnel: Virtual prototyping of parallel computers . In Proceedings of the 1993 ACM SIGMETRICS Conference, May, pp. 48-60 .
22.
Dickens, P. M. , P. Heidelberger , and D. M. Nicol . 1996. Parallelized direct execution simulation of message passing parallel programs . IEEE Transactions on Parallel and Distributed Systems7 (10): 1090-1105 .
23.
Liljenstam, M. , J. Liu , D. M. Nicol , Y. Yuan , G. Yan , and C. Grier . 2005. RINSE: The real-time interactive network simulation environment for network security exercises . Proceedings of the 19th Workshop on Parallel and Distributed Simulation (PADS ’05), Monterey, CA, pp. 119-128 .
24.
Huang, X. W. , R. Sharma , and S. Keshav . 1999. The ENTRAPID protocol development environment . In Proceedings of the 1999 IEEE INFOCOMM Conference, March, pp. 1107-1115 .
25.
Simmonds, R. , and B. Unger . 2003. Towards scalable network emulation . Computer Communications26 (3): 264-277 .
26.
Song, H. J. , X. Liu , D. Jakobsen , R. Bhagwan , X. Zhang , K. Taura , and A. Chien . 2000. The MicroGrid: A scientific tool for modeling computational grids . Scientific Programming8 (3): 127-141 .
27.
Mukherjee, J. 2002. A compiler directed framework for parallel compositional systems. Master’s thesis, Department of Computer Science, Virginia Polytechnic Institute and State University.
28.
Johnson, D. B. 1999. Validation of wireless and mobile network models and simulation . In DARPA/NIST Network Simulation Validation Workshop, May.
29.
Noble, B. D. , M. Satyanarayanan , G. T. Nguyen , and R. H. Katz . 1997. Trace-based mobile network emulation . In Proceedings of the 1997 ACM SIGCOMM Conference, September, pp. 51-61 .
30.
Liu, J. , Y.Yuan , D. M. Nicol , R. S. Gray , C. C. Newport , D. Kotz , and L. F. Perrone . 2004. Simulation validation using direct execution of wireless ad-hoc routing protocols . In Proceedings of the 18th Workshop on Parallel and Distributed Simulation (PADS’04), May, pp. 7-16 .
