Introduction

While developing my dsbox idea i’ve considered building on existing technologies but none of them provided exactly what i wanted. In considering what those technologies lacked, it helped shape something i hope to build, which i am calling Micro-goals

Technologies that didn’t offer what I wanted

• Linux cronjobs
• Yarn map reduce jobs
• Microservices

What I intend for DsBox Micro-goals

Micro-goals will consist of the following criteria

• when to run – the time window ( which may recur )
• where to run – based on hw & resources
• how many instances to run where  1 <= n

dsbox instances will be stopped and started, there will be no permanent leader/master, nodes will use consensus like protocols to agree what runs where. I hope to make this a hive setup with a shared set of goals that are small micro sized.