File Filtering in Stata: Handling Complex Data Formats and Navigating Log Files Efficiently

Abstract

A text file filter is a program that converts one text file into another on the basis of a set of rules. For statistical applications, a text file filter can convert data embedded in a complicated text file so that Stata can read and analyze it. A text file filter can also automate the production of more user-friendly output from long Stata log files. The file command lets you use text file filters in Stata. This article reviews some key programming points for successful implementation of such filters.

Keywords

dm0027 nullfilter matchfilter hyperlog file log navigation text filtering data import data export HTML hyperlink index

References

Shneiderman

1996. The eyes have it: A task by data type taxonomy for information visualizations. In Proceedings of the IEEE Conference on Visual Languages, 336–343. New York: IEEE.

Slaymaker

2005. Using the file command to produce formatted output for other applications. Stata Journal 5: 239–247.

Turner

K. S.

2005. FAQ: What are regular expressions and how can I use them in Stata? http://www.stata.com/support/faqs/data/regex.html.