If you replace functions at runtime, will Clojure/JVM GC old code?

Question

If you replace functions at runtime frequently, the way this poster wanted to do for the purposes of genetic-programming, will Clojure/JVM GC old code?

My "stress-test" of another Lisp here -- two functions call each other in a mutually recursive fashion and get replaced as they do it. — MWB
– MWB, Commented Dec 25, 2020 at 3:18

MWB · Accepted Answer · 2020-12-22 08:50:58Z

5

When in doubt, ask the computer! I wrote a quick test:

(ns tst.demo.core
  (:use demo.core tupelo.core tupelo.test))
  
(defn create-fn
  [n]
  (let [fname   (symbol (format "add-%d" n))
        body    (vector '[x] (list '+ n 'x))
        fn-form (apply list 'clojure.core/defn fname body)
        fn-ref  (eval fn-form)]
    fn-ref))

(defn create-and-call-fn
  [n]
  (let [fn-ref (create-fn n)
        fn-result (fn-ref 3)]
    (when-not (= (+ 3 n) fn-result)
      (throw (ex-info "bad result" (vals->map n fn-result))))))


(dotest
  (let [f5 (create-fn 5)
        f5-result (f5 3)]
    (is= 8 f5-result))
  (dotimes [i 99999]
    (when (zero? (mod i 100)) (spyx i))
    (create-and-call-fn i)))

and up to 100K function creations later, it still works. YMMV!

The above is based on this template project.

edited Dec 22, 2020 at 8:50

MWB

12.7k9 gold badges55 silver badges107 bronze badges

answered Dec 21, 2020 at 19:10

Alan Thompson

30k7 gold badges46 silver badges51 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

MWB Over a year ago

Thanks! Your function probably doesn't get JITed because it's (a) simple (b) gets called only once. I'll try to experiment with it later....

generateme Over a year ago

Clojure function is just an object of the AFn class (github.com/clojure/clojure/blob/master/src/jvm/clojure/lang/…). If a reference to this object (function) is lost, it's GCed.

amalloy Over a year ago

@generateme But when you eval a function, you generate a new class, not just a new object. Whether that class gets cleaned up is less obvious than whether some random lambda does.

Juraj Martinka Over a year ago

@Alan Thompson, your ns declaration is missing a closing paren.

MWB Over a year ago

My "stress-test" of another Lisp here -- two functions call each other in a mutually recursive fashion and get replaced as they do it.

AlBlue · Accepted Answer · 2020-12-23 20:05:26Z

The answer is yes, the generated code should get collected at some point at the future. When it does is not specified; it may happen late, or never.

The other thing to watch out for is (particularly when using code from another eval) is whether you have circular references in the code that gets generated which prevent them from being unloaded. Typically when a ClassLoader gets released, all of its classes get released as well -- and some interpreted/JITd languages on top of the JVM use this to allow the code to be recycled. When the classes are unloaded, any compiled code is also jettisoned -- but if you have a reference to an instance of that class of that classloader (say, in the ThreadLocalStorage) then it will pin the instance, then the class, then the classloader, so it's possible that they will still leak.

Collectives™ on Stack Overflow

If you replace functions at runtime, will Clojure/JVM GC old code?

2 Answers 2

5 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

5 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related