Fractal is a mathematical set that has a fractal dimension which usually exceeds its topological dimension and may be nonintegral. Since the asphalt pavement texture has limitations of randomness and self-similarity, fractal theory has been explored to quantify the asphalt pavement texture and employs good applicability in processing and analyzing the complex details of research object. In this paper, the 2D digital image of the pavement surface is measured in terms of area fractal dimension and contour fractal dimension, which are used to correlate with aggregate gradation and British Pendulum Number (BPN) value, respectively. It turns out the area fractal dimension of aggregate provides a simple way to acquire the continuous gradation of asphalt concrete sample and the contour fractal dimension is an available parameter to characterize roughness and friction of pavement surface texture.