Skip to content

TODO.md

Latest commit

 

History

History
79 lines (60 loc) · 3.61 KB

TODO.md

File metadata and controls

79 lines (60 loc) · 3.61 KB

CLEAR TODO

v0.1-pre: Architectural Preview

Milestone: A working CLEAR VM with debugger, that supports a decent chunk of the language (including concurrency).

v0.1 (Target = May 1)

  • FREEZE + profiling support (detect cache miss problems due to pointer chase, that might be solved with FREEZE)
  • Profiling support to auto-detect fast producer / slow consumer (when to add back pressure)
  • STRUCT/FN DEFAULTS
  • Partial Deadlock protection (in progress - may cancel - primary safety goal is enough syncronization options to not ever need locks in EXTREME STRICT mode, tbd)
  • String@symbol
  • Pipeline support for infinite streams (LIMITed) and unbound finite streams
  • Migrate to Zig 0.16
  • io_uring for networking

v0.2 (Target = July 15)

  • IMMUTABLE Stream Observables (only the stream can mutate the underlying data)
  • Finite State Machines for non-conditional, non-reeentrant, and non-nested looping fibers
  • Re-entrant Thunks (to avoid unbounded recursive growth, auto insert max_depth, auto-insert co-operative yields)
  • Cancelable fibers
  • Built-in support for fiber RACEs
  • Enable MVCC in the language as a syncronization capability (in progress)
  • STRICT mode compilation
  • Native CONCURRENT support for streaming pipelines
  • Observable aggregations for streaming pipelines (@shared aggregate results)
  • VM supporting the vast majority of the language, near Python/Ruby non-JIT speed
  • VM can automatically generate and run LOOM tests for concurrent code
  • An RSpec like testing framework as the first standard library module
  • A statistical benchmarking & profiling framework like Go/Rust
  • ./clear doctor to automatically fix most syntax, conversion, affine errors and profiling recomendations if you choose
  • Demand-based processes - don't spin up the max allowed threads unless there's demand (in progress)
  • HashMap string interning
  • @sorted for lists, sets, hashmaps.

Milestone: Basic SQL/CLEAR database

v0.3 (Target = Oct 1)

  • CPS to support conditional & nested-looping Finite State Machine fibers
  • Full Infinite Stream support
  • Stream Join (declarative, basic)
  • Implement lock-free ringbuffer as a syncronization capability (with backpressure)
  • ARM support
  • Actors as an ownership capability
  • copyOnWrite
  • Ability to write custom Control Plane strategies
  • Control Plane Capability Migration -> live shift contented workloads
  • VM supports entire language, gradual typing.

Milestone: CLEAR-DB with native queries and hot-reload

Vision is clear: Gradual Typing (Ruby/Python) -> Typed (Rust) -> STRICT Typed (HFT-level C speed) -> EXTREME STRICT (ADA-level safety)

./clear doctor + profiling on replay can take you ~95% of the way from an untyped correct app to ADA-level safety and HFT-C speed automatically.

v0.4 (December 25)

  • EXTREME STRICT compilation pt 1: en route to ADA-levels of safety (just blocking compilation where required, ensuring the syntax is forward compatible)
  • MacOS support
  • Ability to write custom capabilities
  • Full Ruby/Elixir Standard Library
  • DISTRIBUTED as a topology
  • Fiber priorities
  • Naive fiber memory budgets (only spawned & transfered memory, not shared memory)
  • Improved fiber fault tolerence

v0.5

  • EXTREME STRICT compilation pt 2: most of ADA's safety
  • Supervisor to kill killable / cancelable bad fibers
  • Control Plane Capability Migration -> live shift skewed workloads

v0.6

  • Persistence / durability (for shared and distributed data)