Skip to content

alternate implementation without transformerlens #29

Open

Description

@wassname

I remember when we were working on this together the paper first came out. Anyway you might be interested in my implementation using baukit instead of transformerlens. The advantage is that you don't need to map the weights, just the layer names. It makes exporting the model easier.

https://github.com/wassname/abliterator

Activity

  1. wassname commented on Mar 11, 2025

    @wassname
    Author

    Also, the bottleneck here is often storing large activations in mem. Here's a nice way to cache them to disk, so that you can abliterate with larger datasets: https://github.com/wassname/activation_store

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions