As a Software Engineer with PromptCloud, you will be responsible for building large-scale web crawling setups that work on our proprietary infrastructure which churns out hundreds of millions of data records every month. To handle data at this scale, we use cutting-edge open source technologies for large-scale data processing like Hadoop, Spark, Redis, MySQL, RabbitMQ, NoSQL Databases and various cloud services like AWS, GCE depending upon specific needs. We are not tied to one technology. Instead, we use what is best suited for the purpose. All of our systems tend to be loosely coupled, communicating using synchronous and asynchronous messaging, leading to a classic large scale distributed data processing architecture.
Work is generally technically deep and demanding, however, that will lead you to have hands-on experience in the latest data crawling and processing technologies and will be working on some truly exciting projects with exceptional colleagues.
Responsibilities and expectations
Ability to work on and be able to identify issues in or improve core infra components related to job scheduling, multi, queuing system etc is needed.
Working with the existing and new crawler.s.
In due course, proficiency to deal with and handle large amount of data and scale is needed.
Analyze business needs and implementation approaches and deliver high-quality applications
Work collaboratively with team members to complete the projects on time.
Work independently and end-to-end with minimal guidance.
Deliver successfully on all aspects of the product lifecycle.
Write well-designed, robust, efficient and testable code
Develop and implement new software components to our existing web crawl platform
Maintain and improve the performance of existing software
Clearly and regularly communicate with management and technical support colleagues.
Create scalable, automated solutions for our customer base
Code refactoring and review
Supportive and creative work environment
20 Annual leaves per year
Flexible working hours
Employee recognition and awards
Wellness program that includes partial-paid gym membership and fully-paid health insurance
Coffee and snacks (of course)
Who we are:
We’re a team of dedicated engineers committed to unlocking the power of data, by extracting and transforming unstructured web data into clean, and ready-to-use data for our clients. An integral part of our offerings is large-scale web crawling and extraction using cloud computing and distributed technologies. We’re on a quest for innovative ways to solve the business problems of data acquisition and normalization on the web. Our vision is to make PromptCloud a one-stop brand for data and our growth is geared towards that.
We have a collaborative and inclusive work environment where individuals can grow their professional careers by working with some of the most advanced technologies and talented team including company founders.
We’re looking for energetic, innovative thinkers who share our vision – and our commitment to our technology leadership and customer success.. If you’re looking for a challenging career with a successful market leader that still has the excitement and hunger of a startup, you should join us as long as you have a passion for technology and are willing to put in an effort to grow further.
Where we are at PromptCloud:
We are a bootstrapped company in the mid-growth phase and are planning to quickly expand (not much in terms of personnel) but heavily with respect to the solutions and global coverage of our clients. Multiple local and global brands are our clients, more details here: (PromptCloud).Skills: Algorithms, Data Structures, Linux, Ruby, Python, C, C++, Java
B.Tech/M.Tech in Computer Science or Information Technology or BE/ME in CS/IT.
0-1 year of professional Software development experience.
Ability to write clean, functional code in Java, C, Python/Perl/Ruby.
Ability to write well-abstracted, reusable code.
Sound knowledge of Algorithms and OOP concepts.
Must have good understanding of software design concepts in large systems..