MIT CBCL Face Detection Data set
http://cbcl.mit.edu/projects/cbcl/software-datasets/FaceData1Readme.html

This is a database of faces and non-faces, that has been used extensively at the Center for Biological and Computational Learning at MIT. It is freely available for research use. If you use this database in published work, you must reference:

CBCL Face Database #1
MIT Center For Biological and Computation Learning
http://www.ai.mit.edu/projects/cbcl


CONTENTS:

Training set: 2,429 faces, 4,548 non-faces 
Test set: 472 faces, 23,573 non-faces

Class 1 is non-face
class 2 is face