Agriculture is one of the most important factors for economic growth for any country. Agriculture plays a very crucial role in increasing the economy of many developing countries. India, being one of the major countries in the world for producing vast amounts of different crops, still uses traditional techniques in the field of agriculture. Farmers not only face problems in coping with the changing climatic conditions but also need to meet up the rising demands of higher food production with good quality. As a matter of fact, Farmers need to be aware of the changing climatic conditions in order for them to yield quality crops. Smart Irrigation would not only help farmers monitor their crops in real time but also would help in recommendations regarding crops and fertilizers. For Worm Detection, we have used image processing using openCV. This paper focuses on proposing Smart Irrigation and Pesticides Management using Worm Detection System, which would help farmers, get recommendations based on various factors like humidity, temperature, and moisture.