Here are a few selected starting points for data analysis..
National Center for Education Statistics (NCES) http://nces.ed.gov/
National Center for Health Statistics http://www.cdc.gov/nchs/
Open Data Inventory (ODIN) http://odin.opendatawatch.com/
Open Data Network http://www.opendatanetwork.com/
Orange - Open Source Data Visualization and Analysis for Novice and Experts http://orange.biolab.si/