One of the mayor goals in computer vision is object representation. Object representation aims to determine a set of features that best represents a specific object in an image, for example interest points, edges, color and texture. However, objects are generally composed of several regions containing different information which is more or less convenient to be represented by one of these features. Furthermore, each of these regions could be static or moving with respect to each other. In this sense, this paper presents an object representation based on fuzzy color blobs and spatial relationships among them. This approach of object representation is used to track rigid and articulated objects.