Anemia is a condition in which the level of hemoglobin in a person's blood is below normal. Hemoglobin concentration is one of the parameters commonly used to determine a person's physical condition. Anemia can attack anyone, especially pregnant women. Currently, many non-invasive anemia detection methods have been developed. One of non-invasive methods in detecting anemia can be seen through its physiological characteristics, namely palpebral conjunctiva images. In this study, conjunctival image-based anemia detection was carried out using one of the deep learning methods, namely Convolutional Neural Netwok (CNN). This CNN method is used with the aim of obtaining more specific characteristics in distinguishing normal and anemic conditions based on the image of the palpebral conjunctiva. The Convolutional Neural Network proposed model in this study consists of five hidden layers, each of which uses a filter size of 3x3, 5x5, 7x7, 9x9, and 11x11 and output channels 16, 32, 64, 128 respectively. Fully connected layer and sigmoid activation function are used to classify normal and anemic conditions. The study was conducted using 2000 images of the palpebral conjunctiva which contained anemia and normal conditions. Furthermore, the dataset is divided into 1,440 images for training, 160 images for validation and 400 images for model testing. The study obtained the best accuracy of 94%, with the average value of precision, recall and f-1 score respectively 0.935; 0.94; 0.935. The results of the study indicate that the system is able to classify normal and anemic conditions with minimal errors. Furthermore, the system that has been designed can be implemented in an Android-based application so that the detection of anemia based on this palpebral conjunctival image can be carried out in real-tim.